[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:15 dist-test-slave-7nm7 krb5kdc[17743](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:15 dist-test-slave-7nm7 krb5kdc[17743](info): set up 2 sockets
Aug 11 02:32:15 dist-test-slave-7nm7 krb5kdc[17743](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 02:32:16.755803 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:16 dist-test-slave-7nm7 krb5kdc[17743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:16.886052 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:34501
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:34501
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:16.979758 17767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:16.979969 17767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:16.980014 17767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:16.981177 17767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:16.981225 17767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:16.981243 17767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:16.981259 17767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:16.981273 17767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:16.982837 17767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:34501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:34501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:16.983160 17767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:16.983413 17767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:16.988831 17775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:16.988844 17776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:16.989609 17767 server_base.cc:1034] running on GCE node
W20260811 02:32:16.989774 17781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:16.990068 17767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:16.990435 17767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:16.991576 17767 hybrid_clock.cc:648] HybridClock initialized: now 1786415536991524 us; error 66 us; skew 500 ppm
Aug 11 02:32:16 dist-test-slave-7nm7 krb5kdc[17743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415536, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:16.994268 17767 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:16.994724 17767 webserver.cc:460] Webserver started at http://127.17.79.62:33189/ using document root <none> and password file <none>
I20260811 02:32:16.994947 17767 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:16.994992 17767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:16.995167 17767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:16.996259 17767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "142f241821994afcb8cca3b214ffd9b4"
format_stamp: "Formatted at 2026-08-11 02:32:16 on dist-test-slave-7nm7"
server_key: "47a623751592806d529feaf9dc10a946"
server_key_iv: "0aa5a663ea0785689eb58db550fe015d"
server_key_version: "encryptionkey@0"
I20260811 02:32:16.996631 17767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "142f241821994afcb8cca3b214ffd9b4"
format_stamp: "Formatted at 2026-08-11 02:32:16 on dist-test-slave-7nm7"
server_key: "47a623751592806d529feaf9dc10a946"
server_key_iv: "0aa5a663ea0785689eb58db550fe015d"
server_key_version: "encryptionkey@0"
I20260811 02:32:16.997999 17767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:16.998838 17793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:16.999035 17767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:16.999137 17767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "142f241821994afcb8cca3b214ffd9b4"
format_stamp: "Formatted at 2026-08-11 02:32:16 on dist-test-slave-7nm7"
server_key: "47a623751592806d529feaf9dc10a946"
server_key_iv: "0aa5a663ea0785689eb58db550fe015d"
server_key_version: "encryptionkey@0"
I20260811 02:32:16.999209 17767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:17.009028 17767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:17.011034 17767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:17.011200 17767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:17.015479 17767 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:34501
I20260811 02:32:17.015554 17892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:34501 every 8 connection(s)
I20260811 02:32:17.015895 17767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:17.016821 17893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:17.019390 17893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4: Bootstrap starting.
I20260811 02:32:17.020068 17893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:17.020388 17893 log.cc:824] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:17.021152 17893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4: No bootstrap required, opened a new log
I20260811 02:32:17.021934 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 17767
I20260811 02:32:17.022013 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:17.022751 17724 external_mini_cluster.cc:1428] Setting key 6d8c095f3fb8aa4778b5c0d3f63a836c
I20260811 02:32:17.023000 17893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142f241821994afcb8cca3b214ffd9b4" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34501 } }
I20260811 02:32:17.023159 17893 raft_consensus.cc:374] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:17.023211 17893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 142f241821994afcb8cca3b214ffd9b4, State: Initialized, Role: FOLLOWER
I20260811 02:32:17.023938 17893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142f241821994afcb8cca3b214ffd9b4" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34501 } }
I20260811 02:32:17.024123 17893 raft_consensus.cc:388] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:17.024178 17893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:17.024226 17893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:17.025255 17893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142f241821994afcb8cca3b214ffd9b4" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34501 } }
I20260811 02:32:17.025512 17893 leader_election.cc:302] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 142f241821994afcb8cca3b214ffd9b4; no voters:
I20260811 02:32:17.025768 17893 leader_election.cc:288] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:17.025815 17903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:17.026000 17903 raft_consensus.cc:686] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 142f241821994afcb8cca3b214ffd9b4, State: Running, Role: LEADER
I20260811 02:32:17.026120 17903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142f241821994afcb8cca3b214ffd9b4" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34501 } }
I20260811 02:32:17.026119 17893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:17.026937 17904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 142f241821994afcb8cca3b214ffd9b4. Latest consensus state: current_term: 1 leader_uuid: "142f241821994afcb8cca3b214ffd9b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142f241821994afcb8cca3b214ffd9b4" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34501 } } }
I20260811 02:32:17.027027 17904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:17.027354 17905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "142f241821994afcb8cca3b214ffd9b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142f241821994afcb8cca3b214ffd9b4" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34501 } } }
I20260811 02:32:17.027444 17905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:17.027572 17917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:17.028103 17917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:17.029978 17917 catalog_manager.cc:1347] Generated new cluster ID: 9f223ea970c4449eb6fcc9f95c436ae2
I20260811 02:32:17.030036 17917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:17.039849 17902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.023660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36130 (local address 127.17.79.62:34501)
0811 02:32:17.023837 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:17.023847 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:17.024110 (+ 263us) server_negotiation.cc:407] Connection header received
0811 02:32:17.026205 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:17.026212 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:17.026348 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:17.026495 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:17.029251 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.030533 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.031605 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.032068 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.032213 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.035903 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:17.035913 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:17.035913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:17.035924 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:17.037751 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.038268 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.038272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.038272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.038389 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.038697 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.038698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.038699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.038949 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:17.039161 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:17.039444 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 02:32:17.039597 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260811 02:32:17.069999 17917 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:17.070760 17917 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:17.075523 17917 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 142f241821994afcb8cca3b214ffd9b4: Generated new TSK 0
I20260811 02:32:17.075693 17917 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:17.109020 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34501
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:17.195706 17935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:17.195919 17935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:17.195945 17935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:17.197153 17935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:17.197204 17935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:17.197234 17935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:17.198809 17935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:17.199098 17935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:17.199384 17935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:17.205833 17949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:17.205842 17952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:17.205842 17950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:17.206423 17935 server_base.cc:1034] running on GCE node
I20260811 02:32:17.206668 17935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:17.206919 17935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:17.208070 17935 hybrid_clock.cc:648] HybridClock initialized: now 1786415537208048 us; error 44 us; skew 500 ppm
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:17.210937 17935 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:17.211650 17935 webserver.cc:460] Webserver started at http://127.17.79.1:43057/ using document root <none> and password file <none>
I20260811 02:32:17.211905 17935 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:17.211982 17935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:17.212157 17935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:17.213310 17935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "f8609dbe9dba4e30812901063c70cff9"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "a1c52a6fa8dbc457c528b7bd7aa56f74"
server_key_iv: "cee5ffdedcd184a53694ee8659df9490"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.213721 17935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "f8609dbe9dba4e30812901063c70cff9"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "a1c52a6fa8dbc457c528b7bd7aa56f74"
server_key_iv: "cee5ffdedcd184a53694ee8659df9490"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.215458 17935 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:17.216513 17965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.216995 17935 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:17.217190 17935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "f8609dbe9dba4e30812901063c70cff9"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "a1c52a6fa8dbc457c528b7bd7aa56f74"
server_key_iv: "cee5ffdedcd184a53694ee8659df9490"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.217324 17935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:17.238368 17935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:17.240846 17935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:17.241040 17935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:17.241642 17935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:17.242225 17935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:17.242352 17935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.242403 17935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:17.242447 17935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.250761 17935 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:45839
I20260811 02:32:17.250941 18171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:45839 every 8 connection(s)
I20260811 02:32:17.251253 17935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:17.255229 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 17935
I20260811 02:32:17.255336 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:17.255483 17724 external_mini_cluster.cc:1428] Setting key 8bef004582f1ee7def029d97508f455e
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:17.262838 17902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.252245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:49259 (local address 127.17.79.62:34501)
0811 02:32:17.252345 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:17.252347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:17.252587 (+ 240us) server_negotiation.cc:407] Connection header received
0811 02:32:17.253086 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:17.253087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:17.253098 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:17.253157 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:17.254149 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.254948 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.256307 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.256619 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.256695 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.259049 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:17.259051 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:17.259051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:17.259059 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:17.261288 (+ 2229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.261786 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.261787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.261787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.261850 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.262122 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.262123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.262124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.262297 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:17.262360 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:17.262653 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 02:32:17.262748 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 02:32:17.263034 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.252202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:34501 (local address 127.17.79.1:49259)
0811 02:32:17.252442 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:17.252487 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:17.253001 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:17.253217 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:17.253220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:17.253811 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:17.254006 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:17.254010 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.255116 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.255117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:17.256145 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:17.256149 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.256734 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.256735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:17.256846 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.257430 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:17.257439 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:17.258944 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:17.261423 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:17.261431 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:17.261433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:17.261676 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:17.261936 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:17.261937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:17.261937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:17.262048 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:17.262361 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:17.262369 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:17.262509 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 02:32:17.262630 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 02:32:17.262794 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":111,"threads_started":1}
I20260811 02:32:17.263759 18173 heartbeater.cc:347] Connected to a master server at 127.17.79.62:34501
I20260811 02:32:17.263871 18173 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:17.264053 18173 heartbeater.cc:511] Master 127.17.79.62:34501 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
I20260811 02:32:17.264981 17822 ts_manager.cc:194] Registered new tserver with Master: f8609dbe9dba4e30812901063c70cff9 (127.17.79.1:45839)
I20260811 02:32:17.265650 17822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:49259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:17.282721 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34501
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:17.368170 18186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:17.368369 18186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:17.368394 18186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:17.369465 18186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:17.369508 18186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:17.369534 18186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:17.371189 18186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:17.371398 18186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:17.371585 18186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:17.376729 18191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:17.376740 18192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:17.376953 18186 server_base.cc:1034] running on GCE node
W20260811 02:32:17.376698 18198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:17.377173 18186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:17.377441 18186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:17.378592 18186 hybrid_clock.cc:648] HybridClock initialized: now 1786415537378580 us; error 33 us; skew 500 ppm
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:17.381304 18186 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:17.381799 18186 webserver.cc:460] Webserver started at http://127.17.79.2:34823/ using document root <none> and password file <none>
I20260811 02:32:17.382057 18186 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:17.382159 18186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:17.382326 18186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:17.383392 18186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "167a018ea121421ca560ecfc02b43a21"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "08bc0f9e3b1f47f2b2a4dbbd8cd2582a"
server_key_iv: "e334f31f198e468aaa1531b98bb6059e"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.383762 18186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "167a018ea121421ca560ecfc02b43a21"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "08bc0f9e3b1f47f2b2a4dbbd8cd2582a"
server_key_iv: "e334f31f198e468aaa1531b98bb6059e"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.385383 18186 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:17.386368 18218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.386554 18186 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:17.386677 18186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "167a018ea121421ca560ecfc02b43a21"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "08bc0f9e3b1f47f2b2a4dbbd8cd2582a"
server_key_iv: "e334f31f198e468aaa1531b98bb6059e"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.386766 18186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:17.396509 18186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:17.398918 18186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:17.399037 18186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:17.399247 18186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:17.399729 18186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:17.399771 18186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.399796 18186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:17.399807 18186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.406639 18186 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:40841
I20260811 02:32:17.406694 18435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:40841 every 8 connection(s)
I20260811 02:32:17.407032 18186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:17.408664 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18186
I20260811 02:32:17.408762 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:17.408936 17724 external_mini_cluster.cc:1428] Setting key 229625b411356dd8988ef197a6f87200
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:17.418277 17902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.407892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:49433 (local address 127.17.79.62:34501)
0811 02:32:17.407983 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:17.407985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:17.408182 (+ 197us) server_negotiation.cc:407] Connection header received
0811 02:32:17.408781 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:17.408782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:17.408796 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:17.408864 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:17.410153 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.410753 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.412104 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.412427 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.412531 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.415092 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:17.415094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:17.415095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:17.415104 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:17.416866 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.417271 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.417273 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.417273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.417338 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.417603 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.417604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.417604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.417741 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:17.417822 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:17.418056 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 02:32:17.418141 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 02:32:17.418397 18439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.407862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:34501 (local address 127.17.79.2:49433)
0811 02:32:17.408050 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:17.408093 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:17.408647 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:17.408936 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:17.408941 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:17.409720 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:17.410013 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:17.410020 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.410853 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.410854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:17.412003 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:17.412006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.412537 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.412538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:17.412652 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.413239 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:17.413247 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:17.414990 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:17.416953 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:17.416960 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:17.416961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:17.417191 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:17.417423 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:17.417424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:17.417424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:17.417523 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:17.417814 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:17.417819 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:17.417926 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 02:32:17.418006 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 02:32:17.418122 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":106,"threads_started":1}
I20260811 02:32:17.418911 18437 heartbeater.cc:347] Connected to a master server at 127.17.79.62:34501
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
I20260811 02:32:17.419018 18437 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:17.419214 18437 heartbeater.cc:511] Master 127.17.79.62:34501 requested a full tablet report, sending...
I20260811 02:32:17.419581 17822 ts_manager.cc:194] Registered new tserver with Master: 167a018ea121421ca560ecfc02b43a21 (127.17.79.2:40841)
I20260811 02:32:17.419991 17822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:49433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:17.436939 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34501
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:17.520749 18442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:17.521013 18442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:17.521112 18442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:17.522346 18442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:17.522409 18442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:17.522485 18442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:17.523981 18442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34501
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:17.524241 18442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:17.524446 18442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:17.530077 18458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:17.530123 18455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:17.530134 18456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:17.530261 18442 server_base.cc:1034] running on GCE node
I20260811 02:32:17.530521 18442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:17.530723 18442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:17.531862 18442 hybrid_clock.cc:648] HybridClock initialized: now 1786415537531848 us; error 34 us; skew 500 ppm
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:17.534548 18442 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:17.535044 18442 webserver.cc:460] Webserver started at http://127.17.79.3:42709/ using document root <none> and password file <none>
I20260811 02:32:17.535290 18442 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:17.535341 18442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:17.535488 18442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:17.536590 18442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "4a1d19fd184444f7bf1976c8f873ed7e"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "dee645d8175c88ab153d7713b1b5e651"
server_key_iv: "74b53278b8ebaf6c08cc9ca426147e50"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.536978 18442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "4a1d19fd184444f7bf1976c8f873ed7e"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "dee645d8175c88ab153d7713b1b5e651"
server_key_iv: "74b53278b8ebaf6c08cc9ca426147e50"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.538569 18442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 02:32:17.539423 18469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.539611 18442 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:17.539722 18442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "4a1d19fd184444f7bf1976c8f873ed7e"
format_stamp: "Formatted at 2026-08-11 02:32:17 on dist-test-slave-7nm7"
server_key: "dee645d8175c88ab153d7713b1b5e651"
server_key_iv: "74b53278b8ebaf6c08cc9ca426147e50"
server_key_version: "encryptionkey@0"
I20260811 02:32:17.539806 18442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:17.577998 18442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:17.580464 18442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:17.580657 18442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:17.580986 18442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:17.581476 18442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:17.581544 18442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.581591 18442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:17.581620 18442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:17.588318 18442 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:46033
I20260811 02:32:17.588363 18666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:46033 every 8 connection(s)
I20260811 02:32:17.588709 18442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:17.592753 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18442
I20260811 02:32:17.592839 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:17.592979 17724 external_mini_cluster.cc:1428] Setting key f4cc6ff23d76a2813f175d399b9fcc7b
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:17.599623 17902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.589510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:52811 (local address 127.17.79.62:34501)
0811 02:32:17.589566 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:17.589568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:17.589827 (+ 259us) server_negotiation.cc:407] Connection header received
0811 02:32:17.590443 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:17.590445 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:17.590460 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:17.590512 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:17.591528 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.592032 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.593323 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.593584 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.593735 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.596280 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:17.596282 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:17.596282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:17.596289 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:17.598169 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.598655 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.598656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.598656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.598716 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.598984 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.598985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.598985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.599132 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:17.599189 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:17.599488 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 02:32:17.599559 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 02:32:17.599759 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.589483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:34501 (local address 127.17.79.3:52811)
0811 02:32:17.589697 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:17.589735 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:17.590327 (+ 592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:17.590604 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:17.590617 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:17.591210 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:17.591410 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:17.591415 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.592131 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.592132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:17.593218 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:17.593221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.593753 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.593754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:17.593901 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.594606 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:17.594615 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:17.596165 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:17.598317 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:17.598324 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:17.598326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:17.598560 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:17.598788 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:17.598788 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:17.598789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:17.598887 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:17.599200 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:17.599206 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:17.599325 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 02:32:17.599419 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 02:32:17.599545 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":112,"threads_started":1}
I20260811 02:32:17.600531 18668 heartbeater.cc:347] Connected to a master server at 127.17.79.62:34501
I20260811 02:32:17.600642 18668 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:17.600795 18668 heartbeater.cc:511] Master 127.17.79.62:34501 requested a full tablet report, sending...
I20260811 02:32:17.601188 17822 ts_manager.cc:194] Registered new tserver with Master: 4a1d19fd184444f7bf1976c8f873ed7e (127.17.79.3:46033)
I20260811 02:32:17.601624 17822 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:52811
I20260811 02:32:17.605387 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:17.631218 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.622121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44650 (local address 127.17.79.1:45839)
0811 02:32:17.622350 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:17.622355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:17.622367 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:17.622414 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:17.622416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:17.622430 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:17.622502 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:17.623093 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.623819 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.624601 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.624938 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.624995 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.628072 (+ 3077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:17.628084 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:17.628085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:17.628095 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:17.629862 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.630316 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.630319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.630319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.630376 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.630594 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.630595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.630595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.630744 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:17.630905 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:17.630992 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 02:32:17.631080 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":125,"threads_started":1}
W20260811 02:32:17.631718 18021 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44650
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[17743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:17.656723 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:17.649280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.17.79.1:45839)
0811 02:32:17.649355 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:17.649357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:17.649430 (+ 73us) server_negotiation.cc:407] Connection header received
0811 02:32:17.649541 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:17.649542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:17.649561 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:17.649625 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:17.650214 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.650751 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.651490 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:17.651698 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:17.651774 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:17.654076 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:17.654077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:17.654077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:17.654084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:17.655501 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.655832 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.655833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.655833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.655885 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:17.656067 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:17.656068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:17.656068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:17.656161 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:17.656254 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:17.656569 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 02:32:17.656652 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:32:17.657511 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 17935
I20260811 02:32:17.668779 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18186
I20260811 02:32:17.689391 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18442
I20260811 02:32:17.697643 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 17767
2026-08-11T02:32:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2307 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[18698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[18698](info): set up 2 sockets
Aug 11 02:32:17 dist-test-slave-7nm7 krb5kdc[18698](info): commencing operation
krb5kdc: starting...
W20260811 02:32:18.990654 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:19.117568 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44365
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:44365
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:19.202984 18722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:19.203239 18722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:19.203279 18722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:19.204434 18722 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:19.204506 18722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:19.204533 18722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:19.204563 18722 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:19.204588 18722 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:19.206127 18722 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:44365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:19.206426 18722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:19.206670 18722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:32:19.211763 18722 server_base.cc:1034] running on GCE node
W20260811 02:32:19.211745 18733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:19.211745 18731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:19.211743 18730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:19.212179 18722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:19.212481 18722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:19.213629 18722 hybrid_clock.cc:648] HybridClock initialized: now 1786415539213605 us; error 41 us; skew 500 ppm
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:19.221276 18722 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:19.221725 18722 webserver.cc:460] Webserver started at http://127.17.79.62:41657/ using document root <none> and password file <none>
I20260811 02:32:19.221980 18722 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:19.222028 18722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:19.222168 18722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:19.223299 18722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "0f8d8a60e203429c9707efe6c2982622"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "707c6546816e70709776172c06c7ac1f"
server_key_iv: "00567f719de955d19a931fbc691aae17"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.223657 18722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "0f8d8a60e203429c9707efe6c2982622"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "707c6546816e70709776172c06c7ac1f"
server_key_iv: "00567f719de955d19a931fbc691aae17"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.225035 18722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 02:32:19.225874 18746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.226056 18722 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:19.226181 18722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "0f8d8a60e203429c9707efe6c2982622"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "707c6546816e70709776172c06c7ac1f"
server_key_iv: "00567f719de955d19a931fbc691aae17"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.226305 18722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:19.244362 18722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:19.246351 18722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:19.246510 18722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:19.250690 18722 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:44365
I20260811 02:32:19.250744 18828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:44365 every 8 connection(s)
I20260811 02:32:19.251118 18722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:19.251988 18830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:19.253355 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18722
I20260811 02:32:19.253424 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:19.253594 17724 external_mini_cluster.cc:1428] Setting key 5a564f6cab445a5abd5c3d062ced8635
I20260811 02:32:19.254565 18830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622: Bootstrap starting.
I20260811 02:32:19.255251 18830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:19.255594 18830 log.cc:824] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:19.256294 18830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622: No bootstrap required, opened a new log
I20260811 02:32:19.258621 18830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f8d8a60e203429c9707efe6c2982622" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44365 } }
I20260811 02:32:19.258823 18830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:19.258875 18830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f8d8a60e203429c9707efe6c2982622, State: Initialized, Role: FOLLOWER
I20260811 02:32:19.259008 18830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f8d8a60e203429c9707efe6c2982622" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44365 } }
I20260811 02:32:19.259104 18830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:19.259143 18830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:19.259186 18830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:19.259984 18830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f8d8a60e203429c9707efe6c2982622" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44365 } }
I20260811 02:32:19.260108 18830 leader_election.cc:302] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f8d8a60e203429c9707efe6c2982622; no voters:
I20260811 02:32:19.260293 18830 leader_election.cc:288] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:19.260366 18838 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:19.260571 18838 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [term 1 LEADER]: Becoming Leader. State: Replica: 0f8d8a60e203429c9707efe6c2982622, State: Running, Role: LEADER
I20260811 02:32:19.260602 18830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:19.262136 18838 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f8d8a60e203429c9707efe6c2982622" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44365 } }
W20260811 02:32:19.263778 18864 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:19.263854 18864 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:19.262778 18841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f8d8a60e203429c9707efe6c2982622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f8d8a60e203429c9707efe6c2982622" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44365 } } }
I20260811 02:32:19.263948 18841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:19.262777 18840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f8d8a60e203429c9707efe6c2982622. Latest consensus state: current_term: 1 leader_uuid: "0f8d8a60e203429c9707efe6c2982622" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f8d8a60e203429c9707efe6c2982622" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44365 } } }
I20260811 02:32:19.264242 18840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:19.264252 18870 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:19.264532 18870 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:19.265348 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.254175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53878 (local address 127.17.79.62:44365)
0811 02:32:19.254351 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.254359 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.254383 (+ 24us) server_negotiation.cc:407] Connection header received
0811 02:32:19.254808 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.254815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.254859 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.254971 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:19.255826 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.256827 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.257909 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.258401 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.258499 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.261430 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:19.261435 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:19.261436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:19.261448 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:19.263512 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.263989 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.263992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.263993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.264122 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.264377 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.264378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.264378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.264684 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:19.264861 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.264992 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.265162 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260811 02:32:19.266072 18870 catalog_manager.cc:1347] Generated new cluster ID: 7ca604230d6c406a981e3d6d5774a500
I20260811 02:32:19.266124 18870 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:19.282140 18870 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:19.282851 18870 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:19.287246 18870 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f8d8a60e203429c9707efe6c2982622: Generated new TSK 0
I20260811 02:32:19.287571 18870 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:19.328910 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44365
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:19.428025 18882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:19.428223 18882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:19.428247 18882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:19.429339 18882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:19.429373 18882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:19.429399 18882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:19.430836 18882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44365
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:19.431082 18882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:19.431295 18882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:19.436237 18892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:19.436246 18888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:19.436255 18889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:19.436513 18882 server_base.cc:1034] running on GCE node
I20260811 02:32:19.436698 18882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:19.436878 18882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:19.438014 18882 hybrid_clock.cc:648] HybridClock initialized: now 1786415539437997 us; error 33 us; skew 500 ppm
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:19.440548 18882 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:19.440992 18882 webserver.cc:460] Webserver started at http://127.17.79.1:46485/ using document root <none> and password file <none>
I20260811 02:32:19.441193 18882 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:19.441242 18882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:19.441326 18882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:19.442340 18882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "09d132da576c47a3b6d18c5059175d20"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "2466c0cb551e4ada0b65c5bad0530693"
server_key_iv: "6be597d8f03cf957f76f60868d151cbc"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.442633 18882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "09d132da576c47a3b6d18c5059175d20"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "2466c0cb551e4ada0b65c5bad0530693"
server_key_iv: "6be597d8f03cf957f76f60868d151cbc"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.443864 18882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:19.444653 18903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.444880 18882 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:19.444988 18882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "09d132da576c47a3b6d18c5059175d20"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "2466c0cb551e4ada0b65c5bad0530693"
server_key_iv: "6be597d8f03cf957f76f60868d151cbc"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.445062 18882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:19.454480 18882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:19.456779 18882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:19.456938 18882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:19.457150 18882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:19.457459 18882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:19.457494 18882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.457533 18882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:19.457559 18882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.463519 18882 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:43251
I20260811 02:32:19.463595 19097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:43251 every 8 connection(s)
I20260811 02:32:19.463914 18882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:19.466521 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18882
I20260811 02:32:19.466595 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:19.466763 17724 external_mini_cluster.cc:1428] Setting key 0e4ceae17f3460f0214fef90fa792cb9
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:19.474432 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.464642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:59719 (local address 127.17.79.62:44365)
0811 02:32:19.464712 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.464714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.464928 (+ 214us) server_negotiation.cc:407] Connection header received
0811 02:32:19.466008 (+ 1080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.466009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.466022 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.466073 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:19.466783 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.467537 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.468532 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.468764 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.468850 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.471282 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:19.471283 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:19.471284 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:19.471290 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:19.472630 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.473131 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.473131 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.473132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.473179 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.473661 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.473662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.473663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.473806 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:19.473872 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.474274 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.474367 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 02:32:19.474629 19102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.464631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44365 (local address 127.17.79.1:59719)
0811 02:32:19.464811 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.464847 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.465884 (+ 1037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.466139 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.466142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.466446 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:19.466676 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.466681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.467639 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.467640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.468442 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.468445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.468862 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.468864 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.468986 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.469530 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:19.469538 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:19.471182 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:19.472713 (+ 1531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:19.472722 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:19.472724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:19.473053 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:19.473254 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:19.473255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:19.473256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:19.473395 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:19.473889 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:19.473896 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:19.474065 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.474195 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.474402 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":101,"threads_started":1}
I20260811 02:32:19.475085 19098 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44365
I20260811 02:32:19.475193 19098 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:19.475376 19098 heartbeater.cc:511] Master 127.17.79.62:44365 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
I20260811 02:32:19.475907 18774 ts_manager.cc:194] Registered new tserver with Master: 09d132da576c47a3b6d18c5059175d20 (127.17.79.1:43251)
I20260811 02:32:19.476531 18774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:59719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:19.493140 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44365
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:19.575955 19106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:19.576198 19106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:19.576249 19106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:19.577402 19106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:19.577468 19106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:19.577513 19106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:19.579030 19106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44365
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:19.579311 19106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:19.579536 19106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:19.584483 19125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:19.584529 19121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:19.584492 19117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:19.584893 19106 server_base.cc:1034] running on GCE node
I20260811 02:32:19.585086 19106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:19.585275 19106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:19.586400 19106 hybrid_clock.cc:648] HybridClock initialized: now 1786415539586372 us; error 42 us; skew 500 ppm
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:19.588846 19106 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:19.589212 19106 webserver.cc:460] Webserver started at http://127.17.79.2:39945/ using document root <none> and password file <none>
I20260811 02:32:19.589383 19106 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:19.589421 19106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:19.589507 19106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:19.590526 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "777523d91c374ea1a1f713903a26bea9"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "d77e5e4da2c95a884b9d80331b8cf45b"
server_key_iv: "f16b81dc2ce2cf0c68ab548081787eb3"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.590828 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "777523d91c374ea1a1f713903a26bea9"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "d77e5e4da2c95a884b9d80331b8cf45b"
server_key_iv: "f16b81dc2ce2cf0c68ab548081787eb3"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.592044 19106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:32:19.592671 19140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.592847 19106 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:19.592938 19106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "777523d91c374ea1a1f713903a26bea9"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "d77e5e4da2c95a884b9d80331b8cf45b"
server_key_iv: "f16b81dc2ce2cf0c68ab548081787eb3"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.593008 19106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:19.607014 19106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:19.608927 19106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:19.609084 19106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:19.609326 19106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:19.609664 19106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:19.609720 19106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.609764 19106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:19.609793 19106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.615727 19106 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:39745
I20260811 02:32:19.615767 19354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:39745 every 8 connection(s)
I20260811 02:32:19.616103 19106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:19.619115 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19106
I20260811 02:32:19.619196 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:19.619391 17724 external_mini_cluster.cc:1428] Setting key fd54746788e370a261b7aa1931a6de71
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:19.626982 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.617003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:48555 (local address 127.17.79.62:44365)
0811 02:32:19.617069 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.617071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.617377 (+ 306us) server_negotiation.cc:407] Connection header received
0811 02:32:19.618426 (+ 1049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.618428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.618449 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.618517 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:19.619330 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.620034 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.621093 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.621311 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.621406 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.623829 (+ 2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:19.623830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:19.623831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:19.623839 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:19.625414 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.625894 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.625895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.625896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.625970 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.626266 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.626268 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.626268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.626405 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:19.626497 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.626787 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.626881 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:32:19.627207 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.616942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44365 (local address 127.17.79.2:48555)
0811 02:32:19.617203 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.617239 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.618152 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.618624 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.618628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.618923 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:19.619164 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.619170 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.620121 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.620122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.620962 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.620964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.621417 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.621419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.621557 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.622171 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:19.622180 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:19.623712 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:19.625539 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:19.625547 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:19.625549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:19.625792 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:19.626047 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:19.626048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:19.626048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:19.626170 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:19.626492 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:19.626500 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:19.626647 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.626766 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.626934 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":168,"threads_started":1}
I20260811 02:32:19.627864 19355 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44365
I20260811 02:32:19.627956 19355 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:19.628177 19355 heartbeater.cc:511] Master 127.17.79.62:44365 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
I20260811 02:32:19.628643 18774 ts_manager.cc:194] Registered new tserver with Master: 777523d91c374ea1a1f713903a26bea9 (127.17.79.2:39745)
I20260811 02:32:19.629050 18774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:48555
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:19.646708 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44365
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:19.734417 19360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:19.734637 19360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:19.734663 19360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:19.735781 19360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:19.735817 19360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:19.735844 19360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:19.737288 19360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44365
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:19.737488 19360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:19.737670 19360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:19.743139 19372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:19.743225 19360 server_base.cc:1034] running on GCE node
W20260811 02:32:19.743192 19374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:19.743137 19370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:19.743572 19360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:19.743799 19360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:19.745007 19360 hybrid_clock.cc:648] HybridClock initialized: now 1786415539744948 us; error 74 us; skew 500 ppm
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:19.748282 19360 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:19.748894 19360 webserver.cc:460] Webserver started at http://127.17.79.3:33965/ using document root <none> and password file <none>
I20260811 02:32:19.749161 19360 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:19.749250 19360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:19.749614 19360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:19.751056 19360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "88500dd546e540aba98a6236a95ed3de"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "05fdbbc2ed060ca7220bbe29168fe5a3"
server_key_iv: "413ff815dfb1e25c82cf4c4da60076b3"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.751498 19360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "88500dd546e540aba98a6236a95ed3de"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "05fdbbc2ed060ca7220bbe29168fe5a3"
server_key_iv: "413ff815dfb1e25c82cf4c4da60076b3"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.753240 19360 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260811 02:32:19.754364 19387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.754575 19360 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:19.754701 19360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "88500dd546e540aba98a6236a95ed3de"
format_stamp: "Formatted at 2026-08-11 02:32:19 on dist-test-slave-7nm7"
server_key: "05fdbbc2ed060ca7220bbe29168fe5a3"
server_key_iv: "413ff815dfb1e25c82cf4c4da60076b3"
server_key_version: "encryptionkey@0"
I20260811 02:32:19.754807 19360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:19.772508 19360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:19.774961 19360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:19.775143 19360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:19.775405 19360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:19.775743 19360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:19.775799 19360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.775844 19360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:19.775875 19360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:19.782004 19360 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:46487
I20260811 02:32:19.782047 19590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:46487 every 8 connection(s)
I20260811 02:32:19.782635 19360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:19.786170 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19360
I20260811 02:32:19.786460 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:19.786669 17724 external_mini_cluster.cc:1428] Setting key 2fd791e8c72c268d082194033ca5cf89
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:19.792848 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.783382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:56957 (local address 127.17.79.62:44365)
0811 02:32:19.783454 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.783456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.783665 (+ 209us) server_negotiation.cc:407] Connection header received
0811 02:32:19.784615 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.784616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.784627 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.784700 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:19.785376 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.785906 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.787499 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.787787 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.787845 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.790018 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:19.790019 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:19.790019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:19.790026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:19.791461 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.791855 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.791856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.791856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.791905 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.792178 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.792179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.792179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.792322 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:19.792390 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.792701 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.792781 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:32:19.792927 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.783349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44365 (local address 127.17.79.3:56957)
0811 02:32:19.783536 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.783579 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.784508 (+ 929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.784788 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.784791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.785052 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:19.785255 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.785259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.786021 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.786022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.787418 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.787422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.787870 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.787872 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.788013 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.788487 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:19.788496 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:19.789926 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:19.791541 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:19.791547 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:19.791549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:19.791784 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:19.791965 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:19.791965 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:19.791966 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:19.792073 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:19.792394 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:19.792399 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:19.792527 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.792631 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.792756 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":109,"threads_started":1}
I20260811 02:32:19.793678 19591 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44365
I20260811 02:32:19.793799 19591 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:19.794003 19591 heartbeater.cc:511] Master 127.17.79.62:44365 requested a full tablet report, sending...
I20260811 02:32:19.794493 18774 ts_manager.cc:194] Registered new tserver with Master: 88500dd546e540aba98a6236a95ed3de (127.17.79.3:46487)
I20260811 02:32:19.794872 18774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:56957
I20260811 02:32:19.798883 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:32:19.807118 18835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.800472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53882 (local address 127.17.79.62:44365)
0811 02:32:19.800545 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.800547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.800611 (+ 64us) server_negotiation.cc:407] Connection header received
0811 02:32:19.800651 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.800651 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.800661 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.800714 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:19.801239 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.801722 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.802628 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.802817 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.802875 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.804063 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:19.804072 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:19.804072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:19.804079 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:19.805645 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.805997 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.805998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.805999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.806057 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.806559 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.806560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.806560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.806723 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:19.806807 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.806933 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.806996 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:32:19.809994 18774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:19.811751 18774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:19.818856 19622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.814801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53368 (local address 127.17.79.3:46487)
0811 02:32:19.815165 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.815170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.815181 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:19.815230 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.815232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.815250 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.815566 (+ 316us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:19.815644 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.816402 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.817668 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.818420 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.818502 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.818563 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.818735 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.818773 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":85,"threads_started":1}
I20260811 02:32:19.818842 19616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.814707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:46487 (local address 127.0.0.1:53368)
0811 02:32:19.814892 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.814930 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.814998 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.815369 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.815372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.815375 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:19.815446 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.815447 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.816507 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.816508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.817572 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.817574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.818513 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.818514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.818596 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.818610 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.818709 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.818768 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20260811 02:32:19.819025 19621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.814747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:43251 (local address 127.0.0.1:46600)
0811 02:32:19.815192 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.815201 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.815236 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.815432 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.815434 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.815436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:19.815496 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.815499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.816996 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.816997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.817893 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.817895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.818787 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.818789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.818854 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.818858 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.818889 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.818931 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":120,"threads_started":1}
I20260811 02:32:19.819233 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.814746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:39745 (local address 127.0.0.1:42188)
0811 02:32:19.815024 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.815034 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.815099 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.815648 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.815649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.815651 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:19.815685 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.815686 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.817057 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.817058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.818114 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.818117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.819015 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.819016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.819076 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.819079 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.819112 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.819149 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":1}
I20260811 02:32:19.819614 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.815036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46600 (local address 127.17.79.1:43251)
0811 02:32:19.815244 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.815249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.815259 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:19.815301 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.815302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.815319 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.815591 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:19.815675 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.816863 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.817975 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.818681 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.819396 (+ 715us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.819462 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.819487 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.819530 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":104,"threads_started":1}
I20260811 02:32:19.819537 19481 tablet_service.cc:1467] Processing CreateTablet for tablet 56c288590ce94aa38ae28e62a001b789 (DEFAULT_TABLE table=test-table [id=bfb4941172de40d1ba8d649491a62f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:19.819952 19481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c288590ce94aa38ae28e62a001b789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:19.819952 19625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.815268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42188 (local address 127.17.79.2:39745)
0811 02:32:19.815479 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.815484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.815492 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:32:19.815531 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.815533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.815548 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.815755 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:19.815830 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.816953 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.818202 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.818926 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.819703 (+ 777us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.819774 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.819820 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.819868 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":95,"threads_started":1}
I20260811 02:32:19.822595 19627 tablet_bootstrap.cc:492] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de: Bootstrap starting.
I20260811 02:32:19.822933 19229 tablet_service.cc:1467] Processing CreateTablet for tablet 56c288590ce94aa38ae28e62a001b789 (DEFAULT_TABLE table=test-table [id=bfb4941172de40d1ba8d649491a62f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:19.823275 19229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c288590ce94aa38ae28e62a001b789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:19.823185 18978 tablet_service.cc:1467] Processing CreateTablet for tablet 56c288590ce94aa38ae28e62a001b789 (DEFAULT_TABLE table=test-table [id=bfb4941172de40d1ba8d649491a62f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:19.823486 19627 tablet_bootstrap.cc:654] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:19.823501 18978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c288590ce94aa38ae28e62a001b789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:19.824198 19627 log.cc:824] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:19.825103 19627 tablet_bootstrap.cc:492] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de: No bootstrap required, opened a new log
I20260811 02:32:19.825181 19627 ts_tablet_manager.cc:1397] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:32:19.826815 19632 tablet_bootstrap.cc:492] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20: Bootstrap starting.
I20260811 02:32:19.826944 19631 tablet_bootstrap.cc:492] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9: Bootstrap starting.
I20260811 02:32:19.827319 19627 raft_consensus.cc:348] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.827500 19627 raft_consensus.cc:374] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:19.827544 19627 raft_consensus.cc:729] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88500dd546e540aba98a6236a95ed3de, State: Initialized, Role: FOLLOWER
I20260811 02:32:19.827554 19632 tablet_bootstrap.cc:654] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:19.827623 19631 tablet_bootstrap.cc:654] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:19.827697 19627 consensus_queue.cc:260] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.828042 19627 ts_tablet_manager.cc:1428] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:19.828048 19591 heartbeater.cc:503] Master 127.17.79.62:44365 was elected leader, sending a full tablet report...
I20260811 02:32:19.828236 19631 log.cc:824] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:19.828382 19632 log.cc:824] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:19.829110 19631 tablet_bootstrap.cc:492] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9: No bootstrap required, opened a new log
I20260811 02:32:19.829181 19631 ts_tablet_manager.cc:1397] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:19.829185 19632 tablet_bootstrap.cc:492] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20: No bootstrap required, opened a new log
I20260811 02:32:19.829260 19632 ts_tablet_manager.cc:1397] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:32:19.830960 19632 raft_consensus.cc:348] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.831116 19632 raft_consensus.cc:374] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:19.831163 19632 raft_consensus.cc:729] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d132da576c47a3b6d18c5059175d20, State: Initialized, Role: FOLLOWER
I20260811 02:32:19.831139 19631 raft_consensus.cc:348] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.831287 19632 consensus_queue.cc:260] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.831342 19631 raft_consensus.cc:374] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:19.831408 19631 raft_consensus.cc:729] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777523d91c374ea1a1f713903a26bea9, State: Initialized, Role: FOLLOWER
I20260811 02:32:19.831542 19631 consensus_queue.cc:260] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.831573 19632 ts_tablet_manager.cc:1428] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 02:32:19.831578 19098 heartbeater.cc:503] Master 127.17.79.62:44365 was elected leader, sending a full tablet report...
I20260811 02:32:19.831823 19355 heartbeater.cc:503] Master 127.17.79.62:44365 was elected leader, sending a full tablet report...
I20260811 02:32:19.831822 19631 ts_tablet_manager.cc:1428] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260811 02:32:19.866729 19356 tablet.cc:2369] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:19.930094 19634 raft_consensus.cc:482] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:19.930323 19634 raft_consensus.cc:504] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.931164 19634 leader_election.cc:288] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777523d91c374ea1a1f713903a26bea9 (127.17.79.2:39745), 09d132da576c47a3b6d18c5059175d20 (127.17.79.1:43251)
I20260811 02:32:19.934980 19625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.931420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:48867 (local address 127.17.79.2:39745)
0811 02:32:19.931502 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.931504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.931516 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:19.931550 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.931551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.931566 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.931643 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:19.931820 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.932582 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.934009 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.934565 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.934633 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.934643 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.934849 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.934897 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:32:19.934985 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.931336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:39745 (local address 127.17.79.3:48867)
0811 02:32:19.931396 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.931409 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.931469 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.931652 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.931653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.931655 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:19.931738 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.931740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.932675 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.932676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.933896 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.933899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.934663 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.934664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.934762 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.934766 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.934832 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.934881 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:32:19.935134 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.931633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:43979 (local address 127.17.79.1:43251)
0811 02:32:19.931731 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.931733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.931792 (+ 59us) server_negotiation.cc:407] Connection header received
0811 02:32:19.931844 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.931845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.931857 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.931919 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:19.932010 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.932690 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.934050 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.934669 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.934753 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.934766 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.934973 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.935051 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 02:32:19.935540 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.931508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:43251 (local address 127.17.79.3:43979)
0811 02:32:19.931710 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:19.931722 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:19.931785 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:19.931924 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:19.931924 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:19.931926 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:19.931971 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.931972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.932769 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.932769 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.933952 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:19.933954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.934773 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.934774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:19.934871 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.934876 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:19.934936 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 02:32:19.934980 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":138,"threads_started":1}
I20260811 02:32:19.935563 19274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c288590ce94aa38ae28e62a001b789" candidate_uuid: "88500dd546e540aba98a6236a95ed3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777523d91c374ea1a1f713903a26bea9" is_pre_election: true
I20260811 02:32:19.935791 19274 raft_consensus.cc:2454] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88500dd546e540aba98a6236a95ed3de in term 0.
I20260811 02:32:19.936019 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c288590ce94aa38ae28e62a001b789" candidate_uuid: "88500dd546e540aba98a6236a95ed3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09d132da576c47a3b6d18c5059175d20" is_pre_election: true
I20260811 02:32:19.936133 19389 leader_election.cc:302] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777523d91c374ea1a1f713903a26bea9, 88500dd546e540aba98a6236a95ed3de; no voters:
I20260811 02:32:19.936205 19005 raft_consensus.cc:2454] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88500dd546e540aba98a6236a95ed3de in term 0.
I20260811 02:32:19.936285 19634 raft_consensus.cc:2781] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:19.936355 19634 raft_consensus.cc:482] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:19.936393 19634 raft_consensus.cc:3037] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:19.951109 19634 raft_consensus.cc:504] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.951340 19634 leader_election.cc:288] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [CANDIDATE]: Term 1 election: Requested vote from peers 777523d91c374ea1a1f713903a26bea9 (127.17.79.2:39745), 09d132da576c47a3b6d18c5059175d20 (127.17.79.1:43251)
I20260811 02:32:19.951588 19274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c288590ce94aa38ae28e62a001b789" candidate_uuid: "88500dd546e540aba98a6236a95ed3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777523d91c374ea1a1f713903a26bea9"
I20260811 02:32:19.951647 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c288590ce94aa38ae28e62a001b789" candidate_uuid: "88500dd546e540aba98a6236a95ed3de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09d132da576c47a3b6d18c5059175d20"
I20260811 02:32:19.951704 19274 raft_consensus.cc:3037] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:19.951776 19005 raft_consensus.cc:3037] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:19.952548 19274 raft_consensus.cc:2454] T 56c288590ce94aa38ae28e62a001b789 P 777523d91c374ea1a1f713903a26bea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88500dd546e540aba98a6236a95ed3de in term 1.
I20260811 02:32:19.952771 19389 leader_election.cc:302] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777523d91c374ea1a1f713903a26bea9, 88500dd546e540aba98a6236a95ed3de; no voters:
I20260811 02:32:19.952862 19005 raft_consensus.cc:2454] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88500dd546e540aba98a6236a95ed3de in term 1.
I20260811 02:32:19.952889 19634 raft_consensus.cc:2781] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:19.953095 19634 raft_consensus.cc:686] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [term 1 LEADER]: Becoming Leader. State: Replica: 88500dd546e540aba98a6236a95ed3de, State: Running, Role: LEADER
I20260811 02:32:19.953210 19634 consensus_queue.cc:237] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } }
I20260811 02:32:19.954286 18774 catalog_manager.cc:5495] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de reported cstate change: term changed from 0 to 1, leader changed from <none> to 88500dd546e540aba98a6236a95ed3de (127.17.79.3). New cstate: current_term: 1 leader_uuid: "88500dd546e540aba98a6236a95ed3de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88500dd546e540aba98a6236a95ed3de" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 46487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777523d91c374ea1a1f713903a26bea9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09d132da576c47a3b6d18c5059175d20" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 43251 } health_report { overall_health: UNKNOWN } } }
W20260811 02:32:19.964702 19099 tablet.cc:2369] T 56c288590ce94aa38ae28e62a001b789 P 09d132da576c47a3b6d18c5059175d20: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:19.973690 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:19.964297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46602 (local address 127.17.79.1:43251)
0811 02:32:19.964371 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:19.964373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:19.964500 (+ 127us) server_negotiation.cc:407] Connection header received
0811 02:32:19.964585 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:19.964586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:19.964601 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:19.964675 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:19.965369 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.965865 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.966929 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:19.967132 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:19.967193 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:19.970032 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:19.970043 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:19.970044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:19.970051 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:19.972072 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.972600 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.972602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.972603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.972661 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:19.973064 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:19.973066 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:19.973066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:19.973254 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:19.973405 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:19.973540 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 02:32:19.973611 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 02:32:19 dist-test-slave-7nm7 krb5kdc[18698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260811 02:32:20.033228 19593 tablet.cc:2369] T 56c288590ce94aa38ae28e62a001b789 P 88500dd546e540aba98a6236a95ed3de: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 02:32:20 dist-test-slave-7nm7 krb5kdc[18698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415539, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:20.043982 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:20.035211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46614 (local address 127.17.79.1:43251)
0811 02:32:20.035306 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:20.035309 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:20.035555 (+ 246us) server_negotiation.cc:407] Connection header received
0811 02:32:20.035592 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:20.035593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:20.035605 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:20.035683 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:20.036481 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:20.037012 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:20.038214 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:20.038502 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:20.038562 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:20.041431 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:20.041432 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:20.041432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:20.041439 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:20.042846 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:20.043199 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:20.043200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:20.043200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:20.043255 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:20.043506 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:20.043507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:20.043507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:20.043606 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:20.043684 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:20.043848 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 02:32:20.043913 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 02:32:20 dist-test-slave-7nm7 krb5kdc[18698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 02:32:20 dist-test-slave-7nm7 krb5kdc[18698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:20.147010 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:20.139112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46622 (local address 127.17.79.1:43251)
0811 02:32:20.139202 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:20.139220 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:20.139291 (+ 71us) server_negotiation.cc:407] Connection header received
0811 02:32:20.139341 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:20.139342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:20.139354 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:20.139437 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:20.140176 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:20.140924 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:20.141695 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:20.142045 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:20.142118 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:20.144560 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:20.144562 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:20.144562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:20.144569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:20.145843 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:20.146360 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:20.146361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:20.146361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:20.146415 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:20.146601 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:20.146602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:20.146602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:20.146691 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:20.146768 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:20.146857 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 02:32:20.146916 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 02:32:20.147778 18944 tablet_service.cc:2908] Rejecting scan request for tablet 56c288590ce94aa38ae28e62a001b789: Uninitialized: clean time has not yet been initialized
I20260811 02:32:20.148737 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18882
I20260811 02:32:20.188536 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19106
I20260811 02:32:20.223910 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19360
I20260811 02:32:20.235988 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18722
2026-08-11T02:32:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2536 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:21 dist-test-slave-7nm7 krb5kdc[19671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:21 dist-test-slave-7nm7 krb5kdc[19671](info): set up 2 sockets
Aug 11 02:32:21 dist-test-slave-7nm7 krb5kdc[19671](info): commencing operation
krb5kdc: starting...
W20260811 02:32:22.992573 17724 mini_kdc.cc:121] Time spent starting KDC: real 2.728s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:23.125811 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45989
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:23.216508 19691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:23.216761 19691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:23.216787 19691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:23.217898 19691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:23.217935 19691 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 02:32:23.217948 19691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:23.217962 19691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:23.217974 19691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:23.217986 19691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:23.219528 19691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45989
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:23.219745 19691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:23.220011 19691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:23.225171 19698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:23.225194 19703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:23.225171 19700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:23.225628 19691 server_base.cc:1034] running on GCE node
I20260811 02:32:23.225942 19691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:23.226384 19691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:23.227596 19691 hybrid_clock.cc:648] HybridClock initialized: now 1786415543227577 us; error 37 us; skew 500 ppm
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:23.231073 19691 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:23.231869 19691 webserver.cc:460] Webserver started at http://127.17.79.62:34881/ using document root <none> and password file <none>
I20260811 02:32:23.232136 19691 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:23.232187 19691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:23.232337 19691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:23.233503 19691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "35b2406ec49edd8e5899cb480daab754"
server_key_iv: "706ddab223274211f3f480f908959d8b"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.233884 19691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "35b2406ec49edd8e5899cb480daab754"
server_key_iv: "706ddab223274211f3f480f908959d8b"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.235548 19691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:23.236768 19716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.236982 19691 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:23.237093 19691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "35b2406ec49edd8e5899cb480daab754"
server_key_iv: "706ddab223274211f3f480f908959d8b"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.237185 19691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:23.267577 19691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:23.269943 19691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:23.270128 19691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:23.275184 19691 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:45989
I20260811 02:32:23.275336 19827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:45989 every 8 connection(s)
I20260811 02:32:23.275632 19691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:23.276356 19831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:23.278761 19831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d: Bootstrap starting.
I20260811 02:32:23.279381 19831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:23.279695 19831 log.cc:824] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:23.280570 19831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d: No bootstrap required, opened a new log
I20260811 02:32:23.281906 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19691
I20260811 02:32:23.282007 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:23.282176 17724 external_mini_cluster.cc:1428] Setting key 1f986a44eeb4f7a472b3e16227809d7e
I20260811 02:32:23.283252 19831 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45989 } }
I20260811 02:32:23.283416 19831 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:23.283481 19831 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afe7dc6aa064dedbfdab06cc49c3b9d, State: Initialized, Role: FOLLOWER
I20260811 02:32:23.283631 19831 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45989 } }
I20260811 02:32:23.283735 19831 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:23.283779 19831 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:23.283828 19831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:23.284437 19831 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45989 } }
I20260811 02:32:23.284559 19831 leader_election.cc:302] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0afe7dc6aa064dedbfdab06cc49c3b9d; no voters:
I20260811 02:32:23.284780 19831 leader_election.cc:288] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:23.284804 19837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:23.284924 19837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [term 1 LEADER]: Becoming Leader. State: Replica: 0afe7dc6aa064dedbfdab06cc49c3b9d, State: Running, Role: LEADER
I20260811 02:32:23.285094 19831 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:23.285066 19837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45989 } }
I20260811 02:32:23.285596 19839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0afe7dc6aa064dedbfdab06cc49c3b9d. Latest consensus state: current_term: 1 leader_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45989 } } }
I20260811 02:32:23.285691 19839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:23.285924 19838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afe7dc6aa064dedbfdab06cc49c3b9d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45989 } } }
I20260811 02:32:23.286031 19838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:23.286428 19852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:23.287006 19852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:23.288810 19852 catalog_manager.cc:1347] Generated new cluster ID: c4093504936c44a0bf6d7803656d7fda
I20260811 02:32:23.288873 19852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:23.294284 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.282836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43498 (local address 127.17.79.62:45989)
0811 02:32:23.283060 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.283069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.283111 (+ 42us) server_negotiation.cc:407] Connection header received
0811 02:32:23.283211 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.283216 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.283260 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.283407 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.284174 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.285652 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.286802 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.287415 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.287534 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.290505 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.290508 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.290508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.290520 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.292466 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.292915 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.292918 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.292918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.293050 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.293296 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.293297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.293298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.293587 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.293748 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.293877 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.294019 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260811 02:32:23.294402 19852 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:23.295167 19852 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:23.300282 19852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d: Generated new TSK 0
I20260811 02:32:23.300500 19852 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:23.333714 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45989
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:23.419255 19868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:23.419456 19868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:23.419480 19868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:23.420749 19868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:23.420794 19868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:23.420816 19868 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:23.420835 19868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:23.422477 19868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:45989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:23.422747 19868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:23.422976 19868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:23.428870 19879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:23.428931 19868 server_base.cc:1034] running on GCE node
W20260811 02:32:23.428817 19876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:23.429006 19882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:23.429347 19868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:23.429647 19868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:23.430801 19868 hybrid_clock.cc:648] HybridClock initialized: now 1786415543430790 us; error 32 us; skew 500 ppm
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:23.433666 19868 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:23.434136 19868 webserver.cc:460] Webserver started at http://127.17.79.1:40715/ using document root <none> and password file <none>
I20260811 02:32:23.434417 19868 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:23.434466 19868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:23.434625 19868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:23.435696 19868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "203b3577461a4104a3dfff78e14f7725"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "fb897949d6d95ffd41de4676c7a953f7"
server_key_iv: "381f69c595ce37999de6d334a2cb086a"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.436056 19868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "203b3577461a4104a3dfff78e14f7725"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "fb897949d6d95ffd41de4676c7a953f7"
server_key_iv: "381f69c595ce37999de6d334a2cb086a"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.437618 19868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:23.438736 19902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.438968 19868 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:23.439065 19868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "203b3577461a4104a3dfff78e14f7725"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "fb897949d6d95ffd41de4676c7a953f7"
server_key_iv: "381f69c595ce37999de6d334a2cb086a"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.439145 19868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:23.464146 19868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:23.466532 19868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:23.466679 19868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:23.467295 19868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:23.467339 19868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.467363 19868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:23.467375 19868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:23.474524 19868 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:39669
I20260811 02:32:23.474610 20106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:39669 every 8 connection(s)
I20260811 02:32:23.474947 19868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:23.477398 19913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.467993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45989 (local address 127.17.79.1:35149)
0811 02:32:23.468216 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.468258 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.468856 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.469182 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.469187 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.469586 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:23.469897 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.469904 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.470997 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.470998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.471926 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.471928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.472374 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.472375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.472509 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.473040 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:23.473049 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:23.474503 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:23.476229 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.476235 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.476237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.476450 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.476631 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.476632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.476632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.476731 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.476940 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:23.476942 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:23.477042 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.477122 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.477249 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":137,"threads_started":1}
I20260811 02:32:23.477595 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.468093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:35149 (local address 127.17.79.62:45989)
0811 02:32:23.468179 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.468184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.468356 (+ 172us) server_negotiation.cc:407] Connection header received
0811 02:32:23.468982 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.468984 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.469002 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.469080 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.470016 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.470880 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.472016 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.472251 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.472340 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.474652 (+ 2312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.474654 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.474654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.474665 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.476132 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.476521 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.476522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.476522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.476575 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.476784 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.476784 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.476784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.476895 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.476941 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.477275 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.477431 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 02:32:23.478345 20110 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45989
I20260811 02:32:23.478461 20110 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:23.478647 20110 heartbeater.cc:511] Master 127.17.79.62:45989 requested a full tablet report, sending...
I20260811 02:32:23.479267 19740 ts_manager.cc:194] Registered new tserver with Master: 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669)
I20260811 02:32:23.480237 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19868
I20260811 02:32:23.480110 19740 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:35149
I20260811 02:32:23.480356 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:23.480545 17724 external_mini_cluster.cc:1428] Setting key d1a35363fcf375d76bf46c5ced8379dd
I20260811 02:32:23.485909 20119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.479667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45989 (local address 127.17.79.1:34857)
0811 02:32:23.479852 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.479872 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.479926 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.480056 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.480056 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.480281 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:23.480363 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.480365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.481254 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.481255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.481743 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.481744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.482281 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.482282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.482356 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.482785 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:23.482790 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:23.483075 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:23.484753 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.484755 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.484755 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.484931 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.485182 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.485182 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.485183 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.485250 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.485572 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:23.485573 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:23.485625 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.485697 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.485803 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":90,"threads_started":1}
I20260811 02:32:23.485987 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.479737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:34857 (local address 127.17.79.62:45989)
0811 02:32:23.479790 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.479793 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.479939 (+ 146us) server_negotiation.cc:407] Connection header received
0811 02:32:23.479964 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.479965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.479975 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.480049 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.480438 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.481165 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.481829 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.482146 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.482217 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.483180 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.483181 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.483182 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.483188 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.484630 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.485021 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.485022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.485023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.485080 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.485322 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.485323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.485323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.485482 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.485591 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.485750 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.485863 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:23.506564 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45989
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:23.590739 20124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:23.590958 20124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:23.590983 20124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:23.592197 20124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:23.592244 20124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:23.592265 20124 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:23.592283 20124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:23.593737 20124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:45989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:23.593982 20124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:23.594265 20124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:23.600039 20132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:23.600164 20136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:23.600066 20140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:23.600373 20124 server_base.cc:1034] running on GCE node
I20260811 02:32:23.600587 20124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:23.600854 20124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:23.602033 20124 hybrid_clock.cc:648] HybridClock initialized: now 1786415543602025 us; error 38 us; skew 500 ppm
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:23.604939 20124 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:23.605402 20124 webserver.cc:460] Webserver started at http://127.17.79.2:45017/ using document root <none> and password file <none>
I20260811 02:32:23.605644 20124 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:23.605718 20124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:23.605870 20124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:23.607013 20124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "ecd3a6e569b04842bcfa492be9d4dc7a"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "20ad9b5c8659668b5970c94d360e0cda"
server_key_iv: "108a4483ab5e3c28f235876a9c0c660b"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.607388 20124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "ecd3a6e569b04842bcfa492be9d4dc7a"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "20ad9b5c8659668b5970c94d360e0cda"
server_key_iv: "108a4483ab5e3c28f235876a9c0c660b"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.608778 20124 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:32:23.609629 20156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.609824 20124 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:23.609936 20124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "ecd3a6e569b04842bcfa492be9d4dc7a"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "20ad9b5c8659668b5970c94d360e0cda"
server_key_iv: "108a4483ab5e3c28f235876a9c0c660b"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.610013 20124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:23.632833 20124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:23.635304 20124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:23.635483 20124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:23.636059 20124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:23.636126 20124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.636176 20124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:23.636207 20124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.644130 20124 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:38137
I20260811 02:32:23.644218 20387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:38137 every 8 connection(s)
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:23.644714 20124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:23.648185 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.636601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:38147 (local address 127.17.79.62:45989)
0811 02:32:23.636667 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.636669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.636889 (+ 220us) server_negotiation.cc:407] Connection header received
0811 02:32:23.637445 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.637446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.637459 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.637524 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.638413 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.639250 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.640892 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.641242 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.641330 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.645129 (+ 3799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.645131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.645131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.645140 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.646697 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.647206 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.647207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.647208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.647271 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.647558 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.647559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.647559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.647680 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.647735 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.648021 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.648112 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 02:32:23.648322 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.636588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45989 (local address 127.17.79.2:38147)
0811 02:32:23.636753 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.636788 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.637332 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.637595 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.637600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.637976 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:23.638297 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.638304 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.639376 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.639377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.640796 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.640800 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.641336 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.641337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.641474 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.642285 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:23.642304 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:23.644995 (+ 2691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:23.646802 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.646809 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.646811 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.647100 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.647382 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.647383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.647383 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.647494 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.647742 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:23.647747 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:23.647869 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.647957 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.648090 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260811 02:32:23.648818 20388 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45989
I20260811 02:32:23.648909 20388 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:23.649107 20388 heartbeater.cc:511] Master 127.17.79.62:45989 requested a full tablet report, sending...
I20260811 02:32:23.649616 19739 ts_manager.cc:194] Registered new tserver with Master: ecd3a6e569b04842bcfa492be9d4dc7a (127.17.79.2:38137)
I20260811 02:32:23.650178 19739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:38147
I20260811 02:32:23.652359 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 20124
I20260811 02:32:23.652494 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:23.652797 17724 external_mini_cluster.cc:1428] Setting key 0a87b176ac734ca1735ae3671c2426f0
I20260811 02:32:23.656363 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.649987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:55631 (local address 127.17.79.62:45989)
0811 02:32:23.650026 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.650028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.650111 (+ 83us) server_negotiation.cc:407] Connection header received
0811 02:32:23.650180 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.650181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.650189 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.650288 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.650647 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.651129 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.651841 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.652044 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.652120 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.653203 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.653204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.653204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.653212 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.655139 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.655510 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.655512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.655512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.655577 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.655839 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.655840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.655840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.655992 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.656048 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.656247 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.656305 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:32:23.656561 20395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.649923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45989 (local address 127.17.79.2:55631)
0811 02:32:23.650061 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.650071 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.650125 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.650298 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.650299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.650508 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:23.650565 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.650567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.651225 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.651226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.651742 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.651744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.652119 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.652120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.652195 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.652703 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:23.652709 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:23.653104 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:23.655241 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.655242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.655242 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.655434 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.655679 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.655680 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.655680 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.655759 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.656059 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:23.656060 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:23.656145 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.656232 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.656358 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:23.681767 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45989
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:23.768278 20403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:23.768481 20403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:23.768505 20403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:23.769577 20403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:23.769618 20403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:23.769637 20403 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:23.769655 20403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:23.771021 20403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:45989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:23.771200 20403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:23.771451 20403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:23.776693 20414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:23.776739 20424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:23.776708 20418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:23.776844 20403 server_base.cc:1034] running on GCE node
I20260811 02:32:23.777148 20403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:23.777421 20403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:23.778599 20403 hybrid_clock.cc:648] HybridClock initialized: now 1786415543778582 us; error 33 us; skew 500 ppm
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:23.781400 20403 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:23.781869 20403 webserver.cc:460] Webserver started at http://127.17.79.3:46517/ using document root <none> and password file <none>
I20260811 02:32:23.782142 20403 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:23.782214 20403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:23.782395 20403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:23.783457 20403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "a84b84a2e79448a894221f345f4cfcca"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "95169f389eb2bf3a825ce2d729c8b7b2"
server_key_iv: "e0de30ad6dc7e38cf5756b784bd69491"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.783861 20403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "a84b84a2e79448a894221f345f4cfcca"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "95169f389eb2bf3a825ce2d729c8b7b2"
server_key_iv: "e0de30ad6dc7e38cf5756b784bd69491"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.786195 20403 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 02:32:23.787164 20441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.787352 20403 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:23.787436 20403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "a84b84a2e79448a894221f345f4cfcca"
format_stamp: "Formatted at 2026-08-11 02:32:23 on dist-test-slave-7nm7"
server_key: "95169f389eb2bf3a825ce2d729c8b7b2"
server_key_iv: "e0de30ad6dc7e38cf5756b784bd69491"
server_key_version: "encryptionkey@0"
I20260811 02:32:23.787484 20403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:23.795635 20403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:23.797802 20403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:23.797912 20403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:23.798444 20403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:23.798488 20403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.798511 20403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:23.798523 20403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.805435 20403 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39195
I20260811 02:32:23.805517 20695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39195 every 8 connection(s)
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:23.805881 20403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:23.808941 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 20403
I20260811 02:32:23.809039 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:23.809118 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.798986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:45779 (local address 127.17.79.62:45989)
0811 02:32:23.799063 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.799066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.799256 (+ 190us) server_negotiation.cc:407] Connection header received
0811 02:32:23.799753 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.799754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.799768 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.799858 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.800707 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.801542 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.803160 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.803496 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.803577 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.806377 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.806379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.806379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.806386 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.807821 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.808215 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.808215 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.808216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.808267 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.808536 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.808536 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.808537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.808635 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.808690 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.808924 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.809008 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:32:23.809214 17724 external_mini_cluster.cc:1428] Setting key bf3cb512b4989510a876c8fd03e29d98
I20260811 02:32:23.809288 20461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.798950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45989 (local address 127.17.79.3:45779)
0811 02:32:23.799126 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.799167 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.799656 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.799930 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.799934 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.800308 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:23.800590 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.800598 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.801659 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.801660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.803058 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.803062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.803598 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.803599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.803745 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.804282 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:23.804294 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:23.806289 (+ 1995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:23.807902 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.807908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.807910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.808139 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.808352 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.808353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.808353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.808463 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.808684 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:23.808687 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:23.808792 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.808869 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.808992 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
I20260811 02:32:23.809825 20698 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45989
I20260811 02:32:23.809933 20698 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:23.810124 20698 heartbeater.cc:511] Master 127.17.79.62:45989 requested a full tablet report, sending...
I20260811 02:32:23.810549 19740 ts_manager.cc:194] Registered new tserver with Master: a84b84a2e79448a894221f345f4cfcca (127.17.79.3:39195)
I20260811 02:32:23.811058 19740 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:45779
I20260811 02:32:23.816586 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.810889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45989 (local address 127.17.79.3:42369)
0811 02:32:23.811239 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.811249 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.811326 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.811456 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.811457 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.811668 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:23.811736 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.811738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.812385 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.812386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.812958 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.812960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.813351 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.813352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.813422 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.813909 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:23.813914 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:23.814306 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:23.815568 (+ 1262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.815569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.815569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.815737 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.815907 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:23.815908 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:23.815908 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:23.815959 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:23.816243 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:23.816244 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:23.816373 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.816437 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.816515 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":62,"threads_started":1}
I20260811 02:32:23.816599 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.810962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:42369 (local address 127.17.79.62:45989)
0811 02:32:23.811000 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.811002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.811314 (+ 312us) server_negotiation.cc:407] Connection header received
0811 02:32:23.811383 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.811384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.811395 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.811451 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.811818 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.812269 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.813075 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.813260 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.813325 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.814387 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.814388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.814388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.814394 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.815499 (+ 1105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.815801 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.815802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.815802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.815851 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.816045 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.816046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.816047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.816168 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.816248 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.816479 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.816543 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:32:23.820987 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 02:32:23 dist-test-slave-7nm7 krb5kdc[19671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:23.844481 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.837398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43500 (local address 127.17.79.62:45989)
0811 02:32:23.837475 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.837477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.837484 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:23.837505 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.837506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.837515 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.837588 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:23.838154 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.838700 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.839450 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.839641 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.839719 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.842117 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:23.842118 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:23.842119 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:23.842126 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:23.843511 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.843852 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.843853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.843853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.843903 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:23.844068 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:23.844069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:23.844069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:23.844168 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:23.844241 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.844351 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.844414 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:32:23.846105 19740 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:23.847782 19740 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:23.854987 20736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.850546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51362 (local address 127.17.79.2:38137)
0811 02:32:23.850763 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.850768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.851070 (+ 302us) server_negotiation.cc:407] Connection header received
0811 02:32:23.851122 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.851124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.851142 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.851219 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:23.851476 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.852627 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.853899 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.854480 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.854589 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.854650 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.854826 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.854872 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":102,"threads_started":1}
I20260811 02:32:23.854993 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.850614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39195 (local address 127.0.0.1:35132)
0811 02:32:23.851068 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.851078 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.851127 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.851413 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.851414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.851416 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:23.851462 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.851464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.852353 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.852354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.853588 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.853591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.854664 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.854665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.854736 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.854741 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.854789 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.854874 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":73,"threads_started":1}
I20260811 02:32:23.855188 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.850569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41842 (local address 127.17.79.1:39669)
0811 02:32:23.850763 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.850768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.850946 (+ 178us) server_negotiation.cc:407] Connection header received
0811 02:32:23.851103 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.851106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.851125 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.851280 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:23.851551 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.852658 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.853934 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.854678 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.854740 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.854789 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.855033 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.855075 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":87,"threads_started":1}
I20260811 02:32:23.855433 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.850731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35132 (local address 127.17.79.3:39195)
0811 02:32:23.850907 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.850912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.851199 (+ 287us) server_negotiation.cc:407] Connection header received
0811 02:32:23.851251 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.851254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.851270 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.851346 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:23.851547 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.852236 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.853690 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.854491 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.854564 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.854625 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.855230 (+ 605us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.855280 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":107,"threads_started":1}
I20260811 02:32:23.855003 20730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.850402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:38137 (local address 127.0.0.1:51362)
0811 02:32:23.850828 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.850873 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.850956 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.851296 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.851300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.851302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:23.851387 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.851389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.852725 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.852727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.853806 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.853808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.854593 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.854595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.854680 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.854695 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.854807 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.854879 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":52,"thread_start_us":65,"threads_started":1}
I20260811 02:32:23.855417 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.850420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39669 (local address 127.0.0.1:41842)
0811 02:32:23.850859 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.850886 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.850956 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.851377 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.851378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.851380 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:23.851459 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.851461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.852747 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.852748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.853838 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.853841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.854823 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.854824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.854889 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.854892 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.854943 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.854979 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":85,"threads_started":1}
I20260811 02:32:23.856242 20265 tablet_service.cc:1467] Processing CreateTablet for tablet 39581e33ad8947668ee9317a3994973d (DEFAULT_TABLE table=test-table [id=64f9f5fa2ca641fdb67f7721f8a96fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:23.856236 20544 tablet_service.cc:1467] Processing CreateTablet for tablet 39581e33ad8947668ee9317a3994973d (DEFAULT_TABLE table=test-table [id=64f9f5fa2ca641fdb67f7721f8a96fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:23.856393 19985 tablet_service.cc:1467] Processing CreateTablet for tablet 39581e33ad8947668ee9317a3994973d (DEFAULT_TABLE table=test-table [id=64f9f5fa2ca641fdb67f7721f8a96fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:23.856608 20544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39581e33ad8947668ee9317a3994973d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:23.856621 20265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39581e33ad8947668ee9317a3994973d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:23.856669 19985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39581e33ad8947668ee9317a3994973d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:23.859985 20740 tablet_bootstrap.cc:492] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Bootstrap starting.
I20260811 02:32:23.860271 20745 tablet_bootstrap.cc:492] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Bootstrap starting.
I20260811 02:32:23.860760 20740 tablet_bootstrap.cc:654] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:23.860906 20745 tablet_bootstrap.cc:654] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:23.861148 20740 log.cc:824] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:23.861260 20745 log.cc:824] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:23.861541 20743 tablet_bootstrap.cc:492] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Bootstrap starting.
I20260811 02:32:23.861995 20740 tablet_bootstrap.cc:492] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: No bootstrap required, opened a new log
I20260811 02:32:23.862071 20740 ts_tablet_manager.cc:1397] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:23.862085 20745 tablet_bootstrap.cc:492] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: No bootstrap required, opened a new log
I20260811 02:32:23.862154 20745 ts_tablet_manager.cc:1397] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:23.862886 20743 tablet_bootstrap.cc:654] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:23.863233 20743 log.cc:824] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:23.863850 20740 raft_consensus.cc:348] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.864002 20740 raft_consensus.cc:374] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:23.864044 20740 raft_consensus.cc:729] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203b3577461a4104a3dfff78e14f7725, State: Initialized, Role: FOLLOWER
I20260811 02:32:23.864070 20743 tablet_bootstrap.cc:492] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: No bootstrap required, opened a new log
I20260811 02:32:23.864137 20743 ts_tablet_manager.cc:1397] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:32:23.864455 20745 raft_consensus.cc:348] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.864619 20745 raft_consensus.cc:374] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:23.864668 20745 raft_consensus.cc:729] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd3a6e569b04842bcfa492be9d4dc7a, State: Initialized, Role: FOLLOWER
I20260811 02:32:23.864795 20745 consensus_queue.cc:260] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.865092 20745 ts_tablet_manager.cc:1428] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:23.865281 20388 heartbeater.cc:503] Master 127.17.79.62:45989 was elected leader, sending a full tablet report...
I20260811 02:32:23.865389 20740 consensus_queue.cc:260] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.865686 20740 ts_tablet_manager.cc:1428] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 02:32:23.865739 20110 heartbeater.cc:503] Master 127.17.79.62:45989 was elected leader, sending a full tablet report...
I20260811 02:32:23.866724 20743 raft_consensus.cc:348] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.866890 20743 raft_consensus.cc:374] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:23.866918 20743 raft_consensus.cc:729] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a84b84a2e79448a894221f345f4cfcca, State: Initialized, Role: FOLLOWER
I20260811 02:32:23.867002 20743 consensus_queue.cc:260] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.867202 20743 ts_tablet_manager.cc:1428] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:23.867301 20698 heartbeater.cc:503] Master 127.17.79.62:45989 was elected leader, sending a full tablet report...
I20260811 02:32:23.868860 20751 raft_consensus.cc:482] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:23.868933 20751 raft_consensus.cc:504] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.869304 20751 leader_election.cc:288] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a84b84a2e79448a894221f345f4cfcca (127.17.79.3:39195), 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669)
I20260811 02:32:23.873467 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.869778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:59495 (local address 127.17.79.1:39669)
0811 02:32:23.869844 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.869846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.869854 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:32:23.869875 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.869876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.869886 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.869942 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:23.870171 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.870939 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.872400 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.872942 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.873024 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.873034 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.873365 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.873413 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 02:32:23.873466 20739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.869678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:48869 (local address 127.17.79.3:39195)
0811 02:32:23.869727 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.869729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.869771 (+ 42us) server_negotiation.cc:407] Connection header received
0811 02:32:23.869843 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.869844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.869856 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.869913 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:23.870171 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.870939 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.872400 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.872951 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.873024 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.873034 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.873257 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.873403 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:23.873474 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.869533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39669 (local address 127.17.79.2:59495)
0811 02:32:23.869608 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.869622 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.869679 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.869955 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.869956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.869957 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:23.870039 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.870041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.871043 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.871044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.872294 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.872298 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.873057 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.873058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.873162 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.873168 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.873241 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.873383 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":128}
I20260811 02:32:23.873487 20760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.869534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39195 (local address 127.17.79.2:48869)
0811 02:32:23.869716 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:23.869727 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:23.869783 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:23.869948 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:23.869949 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:23.869951 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:23.870069 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.870071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.871043 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.871044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.872295 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:23.872298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.873057 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.873058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:23.873162 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.873169 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 02:32:23.873241 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 02:32:23.873384 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":81,"thread_start_us":97,"threads_started":1}
I20260811 02:32:23.873859 20609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39581e33ad8947668ee9317a3994973d" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a84b84a2e79448a894221f345f4cfcca" is_pre_election: true
I20260811 02:32:23.873998 20609 raft_consensus.cc:2454] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 0.
I20260811 02:32:23.874125 20024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39581e33ad8947668ee9317a3994973d" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203b3577461a4104a3dfff78e14f7725" is_pre_election: true
I20260811 02:32:23.874262 20159 leader_election.cc:302] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a84b84a2e79448a894221f345f4cfcca, ecd3a6e569b04842bcfa492be9d4dc7a; no voters:
I20260811 02:32:23.874286 20024 raft_consensus.cc:2454] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 0.
I20260811 02:32:23.874406 20751 raft_consensus.cc:2781] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:23.874455 20751 raft_consensus.cc:482] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:23.874480 20751 raft_consensus.cc:3037] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:23.875357 20751 raft_consensus.cc:504] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.875502 20751 leader_election.cc:288] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 election: Requested vote from peers a84b84a2e79448a894221f345f4cfcca (127.17.79.3:39195), 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669)
I20260811 02:32:23.875701 20609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39581e33ad8947668ee9317a3994973d" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a84b84a2e79448a894221f345f4cfcca"
I20260811 02:32:23.875715 20024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39581e33ad8947668ee9317a3994973d" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203b3577461a4104a3dfff78e14f7725"
I20260811 02:32:23.875779 20024 raft_consensus.cc:3037] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:23.875778 20609 raft_consensus.cc:3037] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:23.876601 20609 raft_consensus.cc:2454] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 1.
I20260811 02:32:23.876601 20024 raft_consensus.cc:2454] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 1.
I20260811 02:32:23.876778 20162 leader_election.cc:302] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203b3577461a4104a3dfff78e14f7725, ecd3a6e569b04842bcfa492be9d4dc7a; no voters:
I20260811 02:32:23.876891 20751 raft_consensus.cc:2781] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:23.877041 20751 raft_consensus.cc:686] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 LEADER]: Becoming Leader. State: Replica: ecd3a6e569b04842bcfa492be9d4dc7a, State: Running, Role: LEADER
I20260811 02:32:23.877141 20751 consensus_queue.cc:237] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } }
I20260811 02:32:23.877890 19739 catalog_manager.cc:5495] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd3a6e569b04842bcfa492be9d4dc7a (127.17.79.2). New cstate: current_term: 1 leader_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } health_report { overall_health: UNKNOWN } } }
I20260811 02:32:23.891705 20736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:23.889061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51372 (local address 127.17.79.2:38137)
0811 02:32:23.889109 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:23.889111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:23.889121 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:23.889245 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:23.889246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:23.889266 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:23.889345 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:23.889457 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.889929 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.890836 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:23.891035 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:23.891122 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:23.891332 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:23.891427 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:23.891519 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:23.891576 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 02:32:23.891599 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:23.893610 20609 raft_consensus.cc:1261] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Refusing update from remote peer ecd3a6e569b04842bcfa492be9d4dc7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:23.893980 20764 consensus_queue.cc:1035] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 02:32:23.895257 20389 tablet.cc:2369] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:23.895856 20024 raft_consensus.cc:1261] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Refusing update from remote peer ecd3a6e569b04842bcfa492be9d4dc7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:23.896215 20764 consensus_queue.cc:1035] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:23.897774 20778 mvcc.cc:205] Tried to move back new op lower bound from 7317158067785080832 to 7317158067721416704. Current Snapshot: MvccSnapshot[applied={T|T < 7317158067785080832}]
I20260811 02:32:23.901214 19739 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:23.901321 19739 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:23.902267 19739 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d: Sending DeleteTablet for 3 replicas of tablet 39581e33ad8947668ee9317a3994973d
I20260811 02:32:23.902724 20544 tablet_service.cc:1514] Processing DeleteTablet for tablet 39581e33ad8947668ee9317a3994973d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:23 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:35132
I20260811 02:32:23.903280 19739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:23.903419 19739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:23.904547 19983 tablet_service.cc:1467] Processing CreateTablet for tablet 1d41a566da7546b79177ec6ce48a1175 (DEFAULT_TABLE table=test-table [id=bd365947a72e457ab0db7692671632b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:23.904639 19985 tablet_service.cc:1514] Processing DeleteTablet for tablet 39581e33ad8947668ee9317a3994973d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:23 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41842
I20260811 02:32:23.904886 20785 tablet_replica.cc:330] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: stopping tablet replica
I20260811 02:32:23.904893 20265 tablet_service.cc:1514] Processing DeleteTablet for tablet 39581e33ad8947668ee9317a3994973d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:23 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:51362
I20260811 02:32:23.905020 19983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d41a566da7546b79177ec6ce48a1175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:23.905117 20785 raft_consensus.cc:2229] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:23.905117 20262 tablet_service.cc:1467] Processing CreateTablet for tablet 1d41a566da7546b79177ec6ce48a1175 (DEFAULT_TABLE table=test-table [id=bd365947a72e457ab0db7692671632b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:23.905217 20262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d41a566da7546b79177ec6ce48a1175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:23.905332 20785 raft_consensus.cc:2258] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:23.905881 20785 ts_tablet_manager.cc:1905] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:23.906378 20544 tablet_service.cc:1467] Processing CreateTablet for tablet 1d41a566da7546b79177ec6ce48a1175 (DEFAULT_TABLE table=test-table [id=bd365947a72e457ab0db7692671632b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:23.906503 20544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d41a566da7546b79177ec6ce48a1175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:23.906725 20745 tablet_bootstrap.cc:492] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: Bootstrap starting.
I20260811 02:32:23.907156 20745 tablet_bootstrap.cc:654] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:23.907775 20785 ts_tablet_manager.cc:1918] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:23.907902 20785 log.cc:1196] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/39581e33ad8947668ee9317a3994973d
I20260811 02:32:23.907971 20745 tablet_bootstrap.cc:492] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: No bootstrap required, opened a new log
I20260811 02:32:23.908020 20743 tablet_bootstrap.cc:492] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Bootstrap starting.
I20260811 02:32:23.908023 20745 ts_tablet_manager.cc:1397] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:23.908192 20745 raft_consensus.cc:348] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:23.908275 20745 raft_consensus.cc:374] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:23.908298 20745 raft_consensus.cc:729] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd3a6e569b04842bcfa492be9d4dc7a, State: Initialized, Role: FOLLOWER
I20260811 02:32:23.908339 20745 consensus_queue.cc:260] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:23.908432 20745 ts_tablet_manager.cc:1428] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.908561 20784 tablet_replica.cc:330] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: stopping tablet replica
I20260811 02:32:23.908617 20743 tablet_bootstrap.cc:654] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:23.908682 20784 raft_consensus.cc:2229] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:23.908793 20784 raft_consensus.cc:2258] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:23.909250 20784 ts_tablet_manager.cc:1905] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:23.908890 20740 tablet_bootstrap.cc:492] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Bootstrap starting.
I20260811 02:32:23.909739 20785 ts_tablet_manager.cc:1939] T 39581e33ad8947668ee9317a3994973d P 203b3577461a4104a3dfff78e14f7725: Deleting consensus metadata
I20260811 02:32:23.909814 20740 tablet_bootstrap.cc:654] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:23.910389 19722 catalog_manager.cc:4841] TS 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669): tablet 39581e33ad8947668ee9317a3994973d (table test-table [id=64f9f5fa2ca641fdb67f7721f8a96fcb]) successfully deleted
I20260811 02:32:23.910580 20743 tablet_bootstrap.cc:492] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: No bootstrap required, opened a new log
I20260811 02:32:23.910624 20786 tablet_replica.cc:330] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: stopping tablet replica
I20260811 02:32:23.910624 20743 ts_tablet_manager.cc:1397] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:23.910718 20786 raft_consensus.cc:2229] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:23.910772 20743 raft_consensus.cc:348] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:23.910838 20743 raft_consensus.cc:374] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:23.910849 20786 raft_consensus.cc:2258] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:23.910859 20743 raft_consensus.cc:729] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a84b84a2e79448a894221f345f4cfcca, State: Initialized, Role: FOLLOWER
I20260811 02:32:23.910882 20784 ts_tablet_manager.cc:1918] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:23.910907 20743 consensus_queue.cc:260] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:23.910943 20784 log.cc:1196] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/39581e33ad8947668ee9317a3994973d
I20260811 02:32:23.910995 20743 ts_tablet_manager.cc:1428] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:23.911214 20784 ts_tablet_manager.cc:1939] T 39581e33ad8947668ee9317a3994973d P a84b84a2e79448a894221f345f4cfcca: Deleting consensus metadata
I20260811 02:32:23.911324 20786 ts_tablet_manager.cc:1905] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:23.911588 19718 catalog_manager.cc:4841] TS a84b84a2e79448a894221f345f4cfcca (127.17.79.3:39195): tablet 39581e33ad8947668ee9317a3994973d (table test-table [id=64f9f5fa2ca641fdb67f7721f8a96fcb]) successfully deleted
I20260811 02:32:23.911882 20740 tablet_bootstrap.cc:492] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: No bootstrap required, opened a new log
I20260811 02:32:23.911937 20740 ts_tablet_manager.cc:1397] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:23.912091 20740 raft_consensus.cc:348] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:23.912146 20740 raft_consensus.cc:374] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:23.912160 20740 raft_consensus.cc:729] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203b3577461a4104a3dfff78e14f7725, State: Initialized, Role: FOLLOWER
I20260811 02:32:23.912215 20740 consensus_queue.cc:260] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:23.912310 20740 ts_tablet_manager.cc:1428] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:23.913573 20786 ts_tablet_manager.cc:1918] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:23.913666 20786 log.cc:1196] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/39581e33ad8947668ee9317a3994973d
I20260811 02:32:23.913962 20786 ts_tablet_manager.cc:1939] T 39581e33ad8947668ee9317a3994973d P ecd3a6e569b04842bcfa492be9d4dc7a: Deleting consensus metadata
I20260811 02:32:23.914350 19718 catalog_manager.cc:4841] TS ecd3a6e569b04842bcfa492be9d4dc7a (127.17.79.2:38137): tablet 39581e33ad8947668ee9317a3994973d (table test-table [id=64f9f5fa2ca641fdb67f7721f8a96fcb]) successfully deleted
W20260811 02:32:23.975746 20111 tablet.cc:2369] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:32:24.056582 20702 tablet.cc:2369] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:24.074453 20751 raft_consensus.cc:482] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:24.074586 20751 raft_consensus.cc:504] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.074796 20751 leader_election.cc:288] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669), a84b84a2e79448a894221f345f4cfcca (127.17.79.3:39195)
I20260811 02:32:24.075172 20024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d41a566da7546b79177ec6ce48a1175" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203b3577461a4104a3dfff78e14f7725" is_pre_election: true
I20260811 02:32:24.075171 20609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d41a566da7546b79177ec6ce48a1175" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a84b84a2e79448a894221f345f4cfcca" is_pre_election: true
I20260811 02:32:24.075333 20024 raft_consensus.cc:2454] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 0.
I20260811 02:32:24.075326 20609 raft_consensus.cc:2454] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 0.
I20260811 02:32:24.075518 20162 leader_election.cc:302] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203b3577461a4104a3dfff78e14f7725, ecd3a6e569b04842bcfa492be9d4dc7a; no voters:
I20260811 02:32:24.075656 20751 raft_consensus.cc:2781] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:24.075700 20751 raft_consensus.cc:482] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:24.075727 20751 raft_consensus.cc:3037] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:24.076470 20751 raft_consensus.cc:504] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.076624 20751 leader_election.cc:288] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 election: Requested vote from peers 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669), a84b84a2e79448a894221f345f4cfcca (127.17.79.3:39195)
I20260811 02:32:24.076778 20024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d41a566da7546b79177ec6ce48a1175" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203b3577461a4104a3dfff78e14f7725"
I20260811 02:32:24.076886 20024 raft_consensus.cc:3037] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:24.076838 20609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d41a566da7546b79177ec6ce48a1175" candidate_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a84b84a2e79448a894221f345f4cfcca"
I20260811 02:32:24.076931 20609 raft_consensus.cc:3037] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:24.077549 20024 raft_consensus.cc:2454] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 1.
I20260811 02:32:24.077688 20609 raft_consensus.cc:2454] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecd3a6e569b04842bcfa492be9d4dc7a in term 1.
I20260811 02:32:24.077745 20162 leader_election.cc:302] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203b3577461a4104a3dfff78e14f7725, ecd3a6e569b04842bcfa492be9d4dc7a; no voters:
I20260811 02:32:24.077854 20751 raft_consensus.cc:2781] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:24.077922 20751 raft_consensus.cc:686] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 LEADER]: Becoming Leader. State: Replica: ecd3a6e569b04842bcfa492be9d4dc7a, State: Running, Role: LEADER
I20260811 02:32:24.077978 20751 consensus_queue.cc:237] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.078838 19739 catalog_manager.cc:5495] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a reported cstate change: term changed from 0 to 1, leader changed from <none> to ecd3a6e569b04842bcfa492be9d4dc7a (127.17.79.2). New cstate: current_term: 1 leader_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } health_report { overall_health: UNKNOWN } } }
Aug 11 02:32:24 dist-test-slave-7nm7 krb5kdc[19671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:24.114934 20798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.107022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45989 (local address 127.0.0.1:43504)
0811 02:32:24.107448 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:24.107470 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:24.107596 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:24.107814 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:24.107815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:24.108139 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:24.108188 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.108190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.108897 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.108898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.109478 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.109480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.109880 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.109881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.109925 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.110537 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:24.110541 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:24.112027 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:24.113742 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:24.113750 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:24.113753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:24.113947 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:24.114174 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:24.114174 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:24.114175 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:24.114277 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:24.114626 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:24.114633 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:24.114681 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 02:32:24.114753 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 02:32:24.114858 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":134,"threads_started":1}
I20260811 02:32:24.115021 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.107140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43504 (local address 127.17.79.62:45989)
0811 02:32:24.107232 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.107235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.107600 (+ 365us) server_negotiation.cc:407] Connection header received
0811 02:32:24.107664 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.107665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.107677 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.107737 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:24.108293 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.108801 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.109585 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.109806 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.109862 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.112120 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:24.112121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:24.112122 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:24.112129 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:24.113644 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:24.114034 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:24.114035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:24.114036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:24.114105 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:24.114368 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:24.114370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:24.114370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:24.114526 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:24.114594 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.114785 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.114926 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":60}
I20260811 02:32:24.117535 19739 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:43504:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 02:32:24.117787 19739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:24.119626 19983 tablet_service.cc:1467] Processing CreateTablet for tablet a1624da5932f4a73998937b2bdf8f44d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=18ad4c0eded843c58b8e9ab189be190c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:24.119855 19983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1624da5932f4a73998937b2bdf8f44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:24.121206 20740 tablet_bootstrap.cc:492] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: Bootstrap starting.
I20260811 02:32:24.119630 20262 tablet_service.cc:1467] Processing CreateTablet for tablet a1624da5932f4a73998937b2bdf8f44d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=18ad4c0eded843c58b8e9ab189be190c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:24.121383 20262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1624da5932f4a73998937b2bdf8f44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:24.121403 20544 tablet_service.cc:1467] Processing CreateTablet for tablet a1624da5932f4a73998937b2bdf8f44d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=18ad4c0eded843c58b8e9ab189be190c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:24.121532 20544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1624da5932f4a73998937b2bdf8f44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:24.121742 20740 tablet_bootstrap.cc:654] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:24.123152 20745 tablet_bootstrap.cc:492] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: Bootstrap starting.
I20260811 02:32:24.123153 20743 tablet_bootstrap.cc:492] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: Bootstrap starting.
I20260811 02:32:24.123473 20740 tablet_bootstrap.cc:492] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: No bootstrap required, opened a new log
I20260811 02:32:24.123528 20740 ts_tablet_manager.cc:1397] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:24.123575 20745 tablet_bootstrap.cc:654] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:24.123621 20743 tablet_bootstrap.cc:654] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:24.123656 20740 raft_consensus.cc:348] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.123706 20740 raft_consensus.cc:374] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:24.123721 20740 raft_consensus.cc:729] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203b3577461a4104a3dfff78e14f7725, State: Initialized, Role: FOLLOWER
I20260811 02:32:24.123782 20740 consensus_queue.cc:260] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.123904 20740 ts_tablet_manager.cc:1428] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:24.123961 20780 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.124027 20780 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:24.124460 20745 tablet_bootstrap.cc:492] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: No bootstrap required, opened a new log
I20260811 02:32:24.124521 20745 ts_tablet_manager.cc:1397] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:24.124637 20745 raft_consensus.cc:348] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.124704 20745 raft_consensus.cc:374] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:24.124763 20745 raft_consensus.cc:729] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd3a6e569b04842bcfa492be9d4dc7a, State: Initialized, Role: FOLLOWER
I20260811 02:32:24.124816 20745 consensus_queue.cc:260] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.124914 20745 ts_tablet_manager.cc:1428] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:24.124943 20751 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.125030 20751 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:24.125157 20743 tablet_bootstrap.cc:492] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: No bootstrap required, opened a new log
I20260811 02:32:24.125208 20743 ts_tablet_manager.cc:1397] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:24.125628 20743 raft_consensus.cc:348] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.125893 20743 raft_consensus.cc:374] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:24.125960 20743 raft_consensus.cc:729] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a84b84a2e79448a894221f345f4cfcca, State: Initialized, Role: FOLLOWER
I20260811 02:32:24.126021 20743 consensus_queue.cc:260] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.126178 20743 ts_tablet_manager.cc:1428] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:24.126358 20758 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.126478 20758 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:24.422010 20758 raft_consensus.cc:482] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:24.422143 20758 raft_consensus.cc:504] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.422680 20758 leader_election.cc:288] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669), ecd3a6e569b04842bcfa492be9d4dc7a (127.17.79.2:38137)
I20260811 02:32:24.425663 20808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.422886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:38137 (local address 127.17.79.3:46561)
0811 02:32:24.423024 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:24.423037 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:24.423097 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:24.423313 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:24.423314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:24.423316 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:24.423376 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.423377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.424025 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.424027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.424832 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.424834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.425412 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.425413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.425477 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.425481 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:24.425533 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 02:32:24.425567 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260811 02:32:24.425686 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.422945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:46561 (local address 127.17.79.2:38137)
0811 02:32:24.423086 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.423089 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.423101 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:24.423167 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.423168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.423181 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.423296 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:24.423471 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.423939 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.424922 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.425322 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.425380 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.425391 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.425557 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.425609 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":62,"threads_started":1}
I20260811 02:32:24.425742 20811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.422953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:37081 (local address 127.17.79.1:39669)
0811 02:32:24.423074 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.423076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.423103 (+ 27us) server_negotiation.cc:407] Connection header received
0811 02:32:24.423171 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.423171 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.423181 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.423252 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:24.423441 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.423940 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.424967 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.425345 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.425439 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.425451 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.425617 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.425662 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":50,"threads_started":1}
I20260811 02:32:24.425777 20807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.422895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39669 (local address 127.17.79.3:37081)
0811 02:32:24.423034 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:24.423047 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:24.423098 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:24.423279 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:24.423281 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:24.423284 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:24.423368 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.423370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.424029 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.424031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.424845 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.424847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.425461 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.425462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.425535 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.425540 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:24.425598 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 02:32:24.425637 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":40,"thread_start_us":69,"threads_started":1}
I20260811 02:32:24.426285 20024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1624da5932f4a73998937b2bdf8f44d" candidate_uuid: "a84b84a2e79448a894221f345f4cfcca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203b3577461a4104a3dfff78e14f7725" is_pre_election: true
I20260811 02:32:24.426383 20024 raft_consensus.cc:2454] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a84b84a2e79448a894221f345f4cfcca in term 0.
I20260811 02:32:24.426185 20302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1624da5932f4a73998937b2bdf8f44d" candidate_uuid: "a84b84a2e79448a894221f345f4cfcca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" is_pre_election: true
I20260811 02:32:24.426466 20302 raft_consensus.cc:2454] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a84b84a2e79448a894221f345f4cfcca in term 0.
I20260811 02:32:24.426566 20449 leader_election.cc:302] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203b3577461a4104a3dfff78e14f7725, a84b84a2e79448a894221f345f4cfcca; no voters:
I20260811 02:32:24.426705 20758 raft_consensus.cc:2781] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:24.426755 20758 raft_consensus.cc:482] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:24.426787 20758 raft_consensus.cc:3037] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:24.427482 20758 raft_consensus.cc:504] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.427635 20758 leader_election.cc:288] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [CANDIDATE]: Term 1 election: Requested vote from peers 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669), ecd3a6e569b04842bcfa492be9d4dc7a (127.17.79.2:38137)
I20260811 02:32:24.427829 20024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1624da5932f4a73998937b2bdf8f44d" candidate_uuid: "a84b84a2e79448a894221f345f4cfcca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203b3577461a4104a3dfff78e14f7725"
I20260811 02:32:24.427913 20024 raft_consensus.cc:3037] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:24.428722 20024 raft_consensus.cc:2454] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a84b84a2e79448a894221f345f4cfcca in term 1.
I20260811 02:32:24.428835 20302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1624da5932f4a73998937b2bdf8f44d" candidate_uuid: "a84b84a2e79448a894221f345f4cfcca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a"
I20260811 02:32:24.428938 20449 leader_election.cc:302] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203b3577461a4104a3dfff78e14f7725, a84b84a2e79448a894221f345f4cfcca; no voters:
I20260811 02:32:24.428972 20302 raft_consensus.cc:3037] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:24.429037 20758 raft_consensus.cc:2781] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:24.429165 20758 raft_consensus.cc:686] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [term 1 LEADER]: Becoming Leader. State: Replica: a84b84a2e79448a894221f345f4cfcca, State: Running, Role: LEADER
I20260811 02:32:24.429267 20758 consensus_queue.cc:237] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } }
I20260811 02:32:24.429723 20814 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: TxnStatusTablet state changed. Reason: New leader a84b84a2e79448a894221f345f4cfcca. Latest consensus state: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.429813 20814 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:24.429904 20302 raft_consensus.cc:2454] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a84b84a2e79448a894221f345f4cfcca in term 1.
I20260811 02:32:24.430053 20818 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 02:32:24.430161 20818 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 02:32:24.430166 19739 catalog_manager.cc:5495] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca reported cstate change: term changed from 0 to 1, leader changed from <none> to a84b84a2e79448a894221f345f4cfcca (127.17.79.3). New cstate: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } health_report { overall_health: HEALTHY } } }
I20260811 02:32:24.468652 20751 consensus_queue.cc:1035] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:24.470500 20751 consensus_queue.cc:1035] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:24.483103 20798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.480315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39195 (local address 127.0.0.1:57988)
0811 02:32:24.480409 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:24.480419 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:24.480458 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:24.480759 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:24.480760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:24.480761 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:24.480817 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.480819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.481484 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.481485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.482063 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.482064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.482542 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.482544 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.482610 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.482628 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:24.482926 (+ 298us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:24.482937 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 02:32:24.482982 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 02:32:24.483033 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 02:32:24.483101 20840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.480394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57988 (local address 127.17.79.3:39195)
0811 02:32:24.480577 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.480580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.480587 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:24.480632 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.480633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.480658 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.480752 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:24.480874 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.481394 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.482152 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.482463 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.482543 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.482743 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:24.482852 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:24.482930 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.482985 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.483006 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":97,"threads_started":1}
I20260811 02:32:24.484414 20024 raft_consensus.cc:1261] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Refusing update from remote peer a84b84a2e79448a894221f345f4cfcca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:24.484524 20302 raft_consensus.cc:1261] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Refusing update from remote peer a84b84a2e79448a894221f345f4cfcca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:24.484864 20814 consensus_queue.cc:1035] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:24.485014 20758 consensus_queue.cc:1035] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca [LEADER]: Connected to new peer: Peer: permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:24.485597 20780 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: TxnStatusTablet state changed. Reason: New leader a84b84a2e79448a894221f345f4cfcca. Latest consensus state: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.485740 20780 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:24.485852 20751 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: TxnStatusTablet state changed. Reason: New leader a84b84a2e79448a894221f345f4cfcca. Latest consensus state: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.485954 20751 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:24.486698 20751 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.486778 20751 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P ecd3a6e569b04842bcfa492be9d4dc7a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:24.486943 20758 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.487041 20758 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:24.487113 20758 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.487155 20758 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P a84b84a2e79448a894221f345f4cfcca: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:24.487540 20834 mvcc.cc:205] Tried to move back new op lower bound from 7317158070206103552 to 7317158069983313920. Current Snapshot: MvccSnapshot[applied={T|T < 7317158070206103552}]
I20260811 02:32:24.487715 20780 tablet_replica.cc:439] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a84b84a2e79448a894221f345f4cfcca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203b3577461a4104a3dfff78e14f7725" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39669 } } peers { permanent_uuid: "ecd3a6e569b04842bcfa492be9d4dc7a" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 38137 } } peers { permanent_uuid: "a84b84a2e79448a894221f345f4cfcca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39195 } } }
I20260811 02:32:24.487809 20780 tablet_replica.cc:442] T a1624da5932f4a73998937b2bdf8f44d P 203b3577461a4104a3dfff78e14f7725: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:24.496052 20840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.492851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:51219 (local address 127.17.79.3:39195)
0811 02:32:24.492918 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.492920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.493061 (+ 141us) server_negotiation.cc:407] Connection header received
0811 02:32:24.493144 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.493145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.493154 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.493205 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:24.493378 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.493841 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.495114 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.495441 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.495596 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.495809 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:24.495842 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:24.495907 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.495974 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.495999 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 02:32:24.496102 20858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.492793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39195 (local address 127.17.79.2:51219)
0811 02:32:24.492979 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:24.492993 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:24.493064 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:24.493229 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:24.493230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:24.493233 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:24.493286 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.493287 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.493933 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.493934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.495001 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.495004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.495612 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.495614 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.495673 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.495690 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:24.495918 (+ 228us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:24.495920 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:24.495966 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 02:32:24.496020 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":114,"threads_started":1}
I20260811 02:32:24.507190 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.504336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:56969 (local address 127.17.79.2:38137)
0811 02:32:24.504400 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.504403 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.504435 (+ 32us) server_negotiation.cc:407] Connection header received
0811 02:32:24.504503 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.504504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.504518 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.504570 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:24.504681 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.505180 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.506267 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.506565 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.506719 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.506910 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:24.506954 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:24.507012 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.507086 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.507110 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:32:24.507241 20861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.504166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:38137 (local address 127.17.79.3:56969)
0811 02:32:24.504373 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:24.504387 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:24.504453 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:24.504571 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:24.504572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:24.504573 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:24.504626 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.504628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.505267 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.505268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.506128 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:24.506130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.506723 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.506724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:24.506786 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.506810 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:24.507025 (+ 215us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:24.507028 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:24.507081 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 02:32:24.507126 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":104,"threads_started":1}
I20260811 02:32:24.516186 19739 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:24.516321 19739 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:24.516999 19739 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0afe7dc6aa064dedbfdab06cc49c3b9d: Sending DeleteTablet for 3 replicas of tablet 1d41a566da7546b79177ec6ce48a1175
I20260811 02:32:24.517309 20544 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d41a566da7546b79177ec6ce48a1175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:24 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:35132
I20260811 02:32:24.517320 20262 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d41a566da7546b79177ec6ce48a1175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:24 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:51362
I20260811 02:32:24.517527 19983 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d41a566da7546b79177ec6ce48a1175 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:24 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41842
I20260811 02:32:24.517767 20866 tablet_replica.cc:330] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: stopping tablet replica
I20260811 02:32:24.517834 20866 raft_consensus.cc:2229] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:24.517872 20866 raft_consensus.cc:2258] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:24.517979 20869 tablet_replica.cc:330] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: stopping tablet replica
I20260811 02:32:24.518034 20869 raft_consensus.cc:2229] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:24.518294 20869 raft_consensus.cc:2258] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:24.518309 20866 ts_tablet_manager.cc:1905] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:24.518589 20869 ts_tablet_manager.cc:1905] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:24.520331 20866 ts_tablet_manager.cc:1918] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:24.520380 20869 ts_tablet_manager.cc:1918] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:24.520443 20869 log.cc:1196] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/1d41a566da7546b79177ec6ce48a1175
I20260811 02:32:24.520531 20866 log.cc:1196] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/1d41a566da7546b79177ec6ce48a1175
I20260811 02:32:24.520746 20869 ts_tablet_manager.cc:1939] T 1d41a566da7546b79177ec6ce48a1175 P ecd3a6e569b04842bcfa492be9d4dc7a: Deleting consensus metadata
I20260811 02:32:24.520929 20866 ts_tablet_manager.cc:1939] T 1d41a566da7546b79177ec6ce48a1175 P a84b84a2e79448a894221f345f4cfcca: Deleting consensus metadata
I20260811 02:32:24.521075 19718 catalog_manager.cc:4841] TS ecd3a6e569b04842bcfa492be9d4dc7a (127.17.79.2:38137): tablet 1d41a566da7546b79177ec6ce48a1175 (table test-table [id=bd365947a72e457ab0db7692671632b4]) successfully deleted
I20260811 02:32:24.521334 19718 catalog_manager.cc:4841] TS a84b84a2e79448a894221f345f4cfcca (127.17.79.3:39195): tablet 1d41a566da7546b79177ec6ce48a1175 (table test-table [id=bd365947a72e457ab0db7692671632b4]) successfully deleted
I20260811 02:32:24.522338 20871 tablet_replica.cc:330] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: stopping tablet replica
I20260811 02:32:24.522406 20871 raft_consensus.cc:2229] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:24.522480 20871 raft_consensus.cc:2258] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:24.522769 20871 ts_tablet_manager.cc:1905] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:24.524044 20871 ts_tablet_manager.cc:1918] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:24.524101 20871 log.cc:1196] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/1d41a566da7546b79177ec6ce48a1175
I20260811 02:32:24.524333 20871 ts_tablet_manager.cc:1939] T 1d41a566da7546b79177ec6ce48a1175 P 203b3577461a4104a3dfff78e14f7725: Deleting consensus metadata
I20260811 02:32:24.524706 19722 catalog_manager.cc:4841] TS 203b3577461a4104a3dfff78e14f7725 (127.17.79.1:39669): tablet 1d41a566da7546b79177ec6ce48a1175 (table test-table [id=bd365947a72e457ab0db7692671632b4]) successfully deleted
Aug 11 02:32:24 dist-test-slave-7nm7 krb5kdc[19671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415543, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:24.531824 20811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.518093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54224 (local address 127.17.79.1:39669)
0811 02:32:24.518136 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.518139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.518394 (+ 255us) server_negotiation.cc:407] Connection header received
0811 02:32:24.518499 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.518500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.518514 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.518544 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:24.519292 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.519990 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.521094 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.521387 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.521435 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.528511 (+ 7076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:24.528521 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:24.528522 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:24.528530 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:24.530496 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:24.530900 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:24.530903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:24.530903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:24.530987 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:24.531226 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:24.531228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:24.531228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:24.531416 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:24.531567 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.531634 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.531732 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 02:32:24.532150 20100 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54224
I20260811 02:32:24.540683 19836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:24.533272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35522 (local address 127.17.79.62:45989)
0811 02:32:24.533318 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:24.533320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:24.533330 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:24.533381 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:24.533382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:24.533393 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:24.533458 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:24.533914 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.534759 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.535673 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:24.535998 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:24.536079 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:24.537408 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:24.537410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:24.537410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:24.537419 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:24.539081 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:24.539527 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:24.539529 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:24.539529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:24.539593 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:24.539831 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:24.539832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:24.539832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:24.539973 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:24.540080 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:24.540431 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 02:32:24.540575 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 02:32:24.540915 19739 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35522
I20260811 02:32:24.541421 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19868
I20260811 02:32:24.559115 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 20124
I20260811 02:32:24.578159 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 20403
I20260811 02:32:24.589392 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19691
2026-08-11T02:32:24Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4356 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:24 dist-test-slave-7nm7 krb5kdc[20879](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:24 dist-test-slave-7nm7 krb5kdc[20879](info): set up 2 sockets
Aug 11 02:32:24 dist-test-slave-7nm7 krb5kdc[20879](info): commencing operation
krb5kdc: starting...
W20260811 02:32:25.912110 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:25 dist-test-slave-7nm7 krb5kdc[20879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:26.037258 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:38097
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:38097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:26.121326 20902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:26.121578 20902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:26.121614 20902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:26.123082 20902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:26.123184 20902 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 02:32:26.123211 20902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:26.123237 20902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:26.123273 20902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:26.123329 20902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:26.125028 20902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:38097
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:38097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:26.125331 20902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:26.125591 20902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:26.130827 20911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:26.130846 20917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:26.130872 20902 server_base.cc:1034] running on GCE node
W20260811 02:32:26.130836 20908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:26.131319 20902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:26.131577 20902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:26.132727 20902 hybrid_clock.cc:648] HybridClock initialized: now 1786415546132709 us; error 27 us; skew 500 ppm
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:26.135599 20902 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:26.136025 20902 webserver.cc:460] Webserver started at http://127.17.79.62:45829/ using document root <none> and password file <none>
I20260811 02:32:26.136250 20902 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:26.136296 20902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:26.136394 20902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:26.137517 20902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "e23eb82312644360b471dc862c469ecd"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "289e5e5c5211c70ae312f4a064b2f342"
server_key_iv: "7182a3d202425c8f43b03095446e822c"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.137841 20902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "e23eb82312644360b471dc862c469ecd"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "289e5e5c5211c70ae312f4a064b2f342"
server_key_iv: "7182a3d202425c8f43b03095446e822c"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.139364 20902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:26.140163 20938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.140383 20902 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:26.140487 20902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "e23eb82312644360b471dc862c469ecd"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "289e5e5c5211c70ae312f4a064b2f342"
server_key_iv: "7182a3d202425c8f43b03095446e822c"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.140560 20902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:26.159067 20902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:26.161898 20902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:26.162030 20902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:26.167062 20902 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:38097
I20260811 02:32:26.167245 21056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:38097 every 8 connection(s)
I20260811 02:32:26.167567 20902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:26.168396 21071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:26.171051 21071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Bootstrap starting.
I20260811 02:32:26.171681 21071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:26.171991 21071 log.cc:824] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:26.172746 21071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: No bootstrap required, opened a new log
I20260811 02:32:26.173950 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 20902
I20260811 02:32:26.174026 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:26.174273 17724 external_mini_cluster.cc:1428] Setting key 02b47476783bed20c938de8a4e98d968
I20260811 02:32:26.175556 21071 raft_consensus.cc:348] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23eb82312644360b471dc862c469ecd" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38097 } }
I20260811 02:32:26.175736 21071 raft_consensus.cc:374] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:26.175778 21071 raft_consensus.cc:729] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23eb82312644360b471dc862c469ecd, State: Initialized, Role: FOLLOWER
I20260811 02:32:26.175937 21071 consensus_queue.cc:260] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23eb82312644360b471dc862c469ecd" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38097 } }
I20260811 02:32:26.176023 21071 raft_consensus.cc:388] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:26.176045 21071 raft_consensus.cc:482] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:26.176111 21071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:26.176818 21071 raft_consensus.cc:504] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23eb82312644360b471dc862c469ecd" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38097 } }
I20260811 02:32:26.176929 21071 leader_election.cc:302] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e23eb82312644360b471dc862c469ecd; no voters:
I20260811 02:32:26.177088 21071 leader_election.cc:288] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:26.177152 21079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:26.177359 21071 sys_catalog.cc:564] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:26.177380 21079 raft_consensus.cc:686] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [term 1 LEADER]: Becoming Leader. State: Replica: e23eb82312644360b471dc862c469ecd, State: Running, Role: LEADER
I20260811 02:32:26.177609 21079 consensus_queue.cc:237] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23eb82312644360b471dc862c469ecd" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38097 } }
I20260811 02:32:26.178022 21080 sys_catalog.cc:455] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e23eb82312644360b471dc862c469ecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23eb82312644360b471dc862c469ecd" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38097 } } }
I20260811 02:32:26.178114 21080 sys_catalog.cc:458] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:26.178313 21081 sys_catalog.cc:455] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e23eb82312644360b471dc862c469ecd. Latest consensus state: current_term: 1 leader_uuid: "e23eb82312644360b471dc862c469ecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e23eb82312644360b471dc862c469ecd" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38097 } } }
I20260811 02:32:26.178375 21081 sys_catalog.cc:458] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd [sys.catalog]: This master's current role is: LEADER
W20260811 02:32:26.179302 21100 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:26.179360 21100 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:26.179406 21092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:26.179543 21092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:26.181985 21092 catalog_manager.cc:1347] Generated new cluster ID: 75b5e87d55ca491c9a8736bdbdc615a1
I20260811 02:32:26.182040 21092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:26.187052 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.174925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46592 (local address 127.17.79.62:38097)
0811 02:32:26.175172 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.175182 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.175217 (+ 35us) server_negotiation.cc:407] Connection header received
0811 02:32:26.175514 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.175522 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.175585 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.175748 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.176489 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.177941 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.179146 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.179757 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.179871 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.182709 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.182713 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.182714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.182725 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.185149 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.185523 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.185526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.185526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.185635 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.185825 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.185826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.185826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.186109 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.186284 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.186704 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.186834 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":99,"threads_started":1}
I20260811 02:32:26.195779 21092 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:26.196321 21092 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:26.199038 21092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Generated new TSK 0
I20260811 02:32:26.199223 21092 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:26.233358 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38097
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:26.334208 21110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:26.334419 21110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:26.334445 21110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:26.335582 21110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:26.335625 21110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:26.335646 21110 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 02:32:26.335659 21110 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:26.335716 21110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:26.337234 21110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:38097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:26.337469 21110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:26.337716 21110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:26.342767 21129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:26.342775 21123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:26.342944 21110 server_base.cc:1034] running on GCE node
W20260811 02:32:26.342862 21122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:26.343295 21110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:26.343511 21110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:26.344771 21110 hybrid_clock.cc:648] HybridClock initialized: now 1786415546344755 us; error 34 us; skew 500 ppm
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:26.347446 21110 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:26.347913 21110 webserver.cc:460] Webserver started at http://127.17.79.1:42157/ using document root <none> and password file <none>
I20260811 02:32:26.348160 21110 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:26.348238 21110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:26.348389 21110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:26.349480 21110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "bdf9f198db3143cbb02f7c1b7d76c203"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "7c47e10c62cc84a5e09cc649a3c721f0"
server_key_iv: "cc6d884c65efe809f5dac36fb4e5bd3b"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.349902 21110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "bdf9f198db3143cbb02f7c1b7d76c203"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "7c47e10c62cc84a5e09cc649a3c721f0"
server_key_iv: "cc6d884c65efe809f5dac36fb4e5bd3b"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.351663 21110 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 02:32:26.352396 21142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.352573 21110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.352676 21110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "bdf9f198db3143cbb02f7c1b7d76c203"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "7c47e10c62cc84a5e09cc649a3c721f0"
server_key_iv: "cc6d884c65efe809f5dac36fb4e5bd3b"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.352761 21110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:26.378023 21110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:26.380539 21110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:26.380723 21110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:26.381554 21110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:26.381618 21110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.381729 21110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:26.381788 21110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:26.389487 21110 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:45965
I20260811 02:32:26.389524 21360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:45965 every 8 connection(s)
I20260811 02:32:26.389853 21110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:26.392196 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.381753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:52701 (local address 127.17.79.62:38097)
0811 02:32:26.381823 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.381826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.382080 (+ 254us) server_negotiation.cc:407] Connection header received
0811 02:32:26.382897 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.382898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.382912 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.382951 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.383903 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.384461 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.386177 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.386478 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.386580 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.389166 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.389168 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.389168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.389176 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.390787 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.391222 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.391224 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.391224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.391287 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.391539 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.391540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.391540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.391665 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.391743 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.392004 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.392106 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 02:32:26.392370 21162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.381755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38097 (local address 127.17.79.1:52701)
0811 02:32:26.381931 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.381981 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.382763 (+ 782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.383052 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.383057 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.383467 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:26.383793 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.383800 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.384552 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.384554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.386069 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.386073 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.386603 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.386604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.386762 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.387374 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:26.387384 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:26.389064 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:26.390887 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.390895 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.390897 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.391126 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.391358 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.391359 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.391359 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.391466 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.391735 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:26.391742 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:26.391873 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.391983 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.392143 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260811 02:32:26.392843 21361 heartbeater.cc:347] Connected to a master server at 127.17.79.62:38097
I20260811 02:32:26.392927 21361 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:26.393126 21361 heartbeater.cc:511] Master 127.17.79.62:38097 requested a full tablet report, sending...
I20260811 02:32:26.393674 20973 ts_manager.cc:194] Registered new tserver with Master: bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965)
I20260811 02:32:26.394719 20973 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:52701
I20260811 02:32:26.399329 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.393949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:44691 (local address 127.17.79.62:38097)
0811 02:32:26.393994 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.393996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.394152 (+ 156us) server_negotiation.cc:407] Connection header received
0811 02:32:26.394205 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.394206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.394218 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.394334 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.394696 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.395255 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.396013 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.396192 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.396247 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.397030 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.397031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.397031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.397037 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.398473 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.398764 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.398765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.398766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.398814 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.398957 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.398957 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.398958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.399049 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.399094 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.399215 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.399272 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:32:26.399338 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.393860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38097 (local address 127.17.79.1:44691)
0811 02:32:26.394040 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.394051 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.394125 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.394347 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.394348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.394537 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:26.394597 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.394598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.395346 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.395347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.395935 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.395937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.396258 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.396259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.396323 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.396689 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:26.396693 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:26.396954 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:26.398543 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.398544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.398544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.398701 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.398871 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.398871 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.398872 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.398920 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.399099 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:26.399100 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:26.399133 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.399202 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.399275 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":109,"threads_started":1}
I20260811 02:32:26.399700 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21110
I20260811 02:32:26.399812 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:26.399979 17724 external_mini_cluster.cc:1428] Setting key 566dcb2648e6ae8fcab6ec6389ed0bda
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:26.427081 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38097
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:26.516259 21384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:26.516500 21384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:26.516543 21384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:26.517657 21384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:26.517725 21384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:26.517762 21384 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 02:32:26.517791 21384 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:26.517823 21384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:26.519266 21384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:38097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:26.519533 21384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:26.519775 21384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:26.524936 21390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:26.524982 21392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:26.524992 21384 server_base.cc:1034] running on GCE node
W20260811 02:32:26.524936 21396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:26.525349 21384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:26.525602 21384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:26.526769 21384 hybrid_clock.cc:648] HybridClock initialized: now 1786415546526754 us; error 30 us; skew 500 ppm
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:26.529524 21384 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:26.529973 21384 webserver.cc:460] Webserver started at http://127.17.79.2:35351/ using document root <none> and password file <none>
I20260811 02:32:26.530213 21384 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:26.530319 21384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:26.530481 21384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:26.531546 21384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "667238ce1ca24e9f9477d57cf2ce2104"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "8cd5e88da15ba1f57a8e690b6e82c080"
server_key_iv: "435996124259c347e489ca58d5c48550"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.531932 21384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "667238ce1ca24e9f9477d57cf2ce2104"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "8cd5e88da15ba1f57a8e690b6e82c080"
server_key_iv: "435996124259c347e489ca58d5c48550"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.533478 21384 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:26.534329 21414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.534515 21384 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:26.534626 21384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "667238ce1ca24e9f9477d57cf2ce2104"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "8cd5e88da15ba1f57a8e690b6e82c080"
server_key_iv: "435996124259c347e489ca58d5c48550"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.534719 21384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:26.542699 21384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:26.544968 21384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:26.545130 21384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:26.545674 21384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:26.545739 21384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.545782 21384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:26.545810 21384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.552763 21384 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:37243
I20260811 02:32:26.552811 21621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:37243 every 8 connection(s)
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:26.553247 21384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:26.557045 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.546189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:59303 (local address 127.17.79.62:38097)
0811 02:32:26.546292 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.546295 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.546479 (+ 184us) server_negotiation.cc:407] Connection header received
0811 02:32:26.546956 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.546957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.546970 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.547053 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.547916 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.548751 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.550338 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.550683 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.550772 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.553939 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.553941 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.553941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.553949 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.555607 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.556082 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.556083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.556083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.556160 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.556435 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.556436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.556436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.556547 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.556616 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.556915 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.556982 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 02:32:26.557348 21435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.546161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38097 (local address 127.17.79.2:59303)
0811 02:32:26.546344 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.546384 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.546855 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.547135 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.547139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.547505 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:26.547796 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.547804 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.548858 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.548859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.550225 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.550253 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.550793 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.550794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.550951 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.551621 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:26.551632 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:26.553823 (+ 2191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:26.555691 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.555697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.555699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.556005 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.556259 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.556260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.556260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.556368 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.556653 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:26.556660 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:26.556799 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.556898 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.557108 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
I20260811 02:32:26.557951 21622 heartbeater.cc:347] Connected to a master server at 127.17.79.62:38097
I20260811 02:32:26.558056 21622 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:26.558303 21622 heartbeater.cc:511] Master 127.17.79.62:38097 requested a full tablet report, sending...
I20260811 02:32:26.558785 20974 ts_manager.cc:194] Registered new tserver with Master: 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243)
I20260811 02:32:26.559222 20974 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:59303
I20260811 02:32:26.563345 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21384
I20260811 02:32:26.563457 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:26.563650 17724 external_mini_cluster.cc:1428] Setting key a6ffc2a78b718bdf50a4432144a8eaaa
I20260811 02:32:26.565328 21637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.559083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38097 (local address 127.17.79.2:45063)
0811 02:32:26.559249 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.559267 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.559341 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.559458 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.559459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.559649 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:26.559710 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.559712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.560360 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.560361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.560866 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.560868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.561254 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.561255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.561331 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.561795 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:26.561800 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:26.562077 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:26.564150 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.564151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.564151 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.564392 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.564639 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.564640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.564640 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.564689 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.565053 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:26.565053 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:26.565112 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.565178 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.565256 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
I20260811 02:32:26.565466 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.559147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:45063 (local address 127.17.79.62:38097)
0811 02:32:26.559194 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.559196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.559326 (+ 130us) server_negotiation.cc:407] Connection header received
0811 02:32:26.559391 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.559392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.559401 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.559445 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.559791 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.560262 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.560953 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.561164 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.561251 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.562325 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.562327 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.562327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.562335 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.564041 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.564477 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.564479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.564479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.564562 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.564766 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.564767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.564768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.564973 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.565058 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.565230 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.565325 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:26.590487 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38097
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:44617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:26.675909 21642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:26.676133 21642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:26.676160 21642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:26.677388 21642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:26.677433 21642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:26.677453 21642 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 02:32:26.677465 21642 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:26.677484 21642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:26.679247 21642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:44617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:38097
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:26.679467 21642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:26.679647 21642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:26.685608 21649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:26.685611 21652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:26.685719 21648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:26.685629 21642 server_base.cc:1034] running on GCE node
I20260811 02:32:26.686013 21642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:26.686342 21642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:26.687513 21642 hybrid_clock.cc:648] HybridClock initialized: now 1786415546687507 us; error 38 us; skew 500 ppm
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:26.690062 21642 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:26.690564 21642 webserver.cc:460] Webserver started at http://127.17.79.3:32945/ using document root <none> and password file <none>
I20260811 02:32:26.690764 21642 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:26.690807 21642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:26.690899 21642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:26.691919 21642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "ffe16dc60f3747539b08f9e7dfa0cb15"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "209d787542d8ebeeaa6f5724395b4165"
server_key_iv: "cfeeb8a25654c2fb6b0384bf645e7336"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.692284 21642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "ffe16dc60f3747539b08f9e7dfa0cb15"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "209d787542d8ebeeaa6f5724395b4165"
server_key_iv: "cfeeb8a25654c2fb6b0384bf645e7336"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.693848 21642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:26.694756 21662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.694953 21642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:26.695046 21642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "ffe16dc60f3747539b08f9e7dfa0cb15"
format_stamp: "Formatted at 2026-08-11 02:32:26 on dist-test-slave-7nm7"
server_key: "209d787542d8ebeeaa6f5724395b4165"
server_key_iv: "cfeeb8a25654c2fb6b0384bf645e7336"
server_key_version: "encryptionkey@0"
I20260811 02:32:26.695111 21642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:26.710682 21642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:26.712988 21642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:26.713229 21642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:26.713747 21642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:26.713789 21642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.713814 21642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:26.713827 21642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:26.721217 21642 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39501
I20260811 02:32:26.721277 21866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39501 every 8 connection(s)
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:26.721647 21642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:26.724542 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.714372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:49705 (local address 127.17.79.62:38097)
0811 02:32:26.714434 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.714437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.714627 (+ 190us) server_negotiation.cc:407] Connection header received
0811 02:32:26.715367 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.715369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.715383 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.715457 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.716344 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.717127 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.718928 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.719240 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.719340 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.722169 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.722171 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.722171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.722179 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.723413 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.723788 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.723788 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.723788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.723839 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.724043 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.724043 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.724044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.724145 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.724198 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.724419 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.724480 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 02:32:26.724767 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.714292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38097 (local address 127.17.79.3:49705)
0811 02:32:26.714497 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.714541 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.715056 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.715549 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.715553 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.715927 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:26.716259 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.716266 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.717227 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.717227 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.718819 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.718822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.719360 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.719361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.719469 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.720181 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:26.720207 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:26.722062 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:26.723495 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.723501 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.723503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.723718 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.723897 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.723898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.723898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.723990 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.724198 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:26.724202 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:26.724313 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.724393 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.724509 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":100,"threads_started":1}
I20260811 02:32:26.725298 21869 heartbeater.cc:347] Connected to a master server at 127.17.79.62:38097
I20260811 02:32:26.725384 21869 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:26.725566 21869 heartbeater.cc:511] Master 127.17.79.62:38097 requested a full tablet report, sending...
I20260811 02:32:26.725975 20973 ts_manager.cc:194] Registered new tserver with Master: ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501)
I20260811 02:32:26.726496 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21642
I20260811 02:32:26.726562 20973 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:49705
I20260811 02:32:26.726617 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:26.726827 17724 external_mini_cluster.cc:1428] Setting key 0ab7525f68f2c1c480457d0e13716b4f
I20260811 02:32:26.727667 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:32:26.733907 21882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.726342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38097 (local address 127.17.79.3:37139)
0811 02:32:26.726833 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.726845 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.727454 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.727735 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.727736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.727931 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:26.727992 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.727994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.728762 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.728763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.729592 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.729595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.729934 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.729936 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.730020 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.730556 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:26.730560 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:26.730846 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:26.732457 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.732458 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.732459 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.732728 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.732961 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:26.732962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:26.732963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:26.733039 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:26.733564 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:26.733565 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:26.733629 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.733710 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.733824 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":84,"threads_started":1}
I20260811 02:32:26.733991 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.726417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:37139 (local address 127.17.79.62:38097)
0811 02:32:26.726702 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.726704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.726895 (+ 191us) server_negotiation.cc:407] Connection header received
0811 02:32:26.727639 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.727640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.727652 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.727734 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.728070 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.728662 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.729685 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.729859 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.729915 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.730936 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.730938 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.730938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.730946 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.732372 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.732817 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.732819 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.732820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.732884 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.733219 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.733221 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.733221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.733484 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.733548 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.733770 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.733875 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265}
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 02:32:26 dist-test-slave-7nm7 krb5kdc[20879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:26.754091 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.746827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46594 (local address 127.17.79.62:38097)
0811 02:32:26.746904 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.746906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.746916 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:26.746944 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.746945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.746960 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.747017 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:26.747596 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.748101 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.748936 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.749140 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.749203 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.751703 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:26.751704 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:26.751704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:26.751711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:26.753114 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.753429 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.753430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.753431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.753483 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:26.753692 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:26.753693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:26.753693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:26.753797 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:26.753873 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.753966 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.754023 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 02:32:26.755906 20973 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:26.757493 20973 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:26.764770 21908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.760373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39501 (local address 127.0.0.1:38128)
0811 02:32:26.761168 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.761177 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.761216 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.761427 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.761428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.761429 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:26.761472 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.761474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.762671 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.762673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.763758 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.763760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.764419 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.764420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.764516 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.764531 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.764599 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.764662 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"mutex_wait_us":2,"thread_start_us":109,"threads_started":1}
I20260811 02:32:26.764807 21912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.760553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49286 (local address 127.17.79.1:45965)
0811 02:32:26.760755 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.760761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.760773 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:26.760814 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.760816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.760832 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.760930 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:26.761094 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.762293 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.763759 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.764452 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.764534 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.764586 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.764660 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.764693 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":93,"threads_started":1}
I20260811 02:32:26.764900 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.760643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60508 (local address 127.17.79.2:37243)
0811 02:32:26.760828 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.760831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.761093 (+ 262us) server_negotiation.cc:407] Connection header received
0811 02:32:26.761148 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.761150 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.761167 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.761258 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:26.761484 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.762355 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.763588 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.764326 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.764400 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.764459 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.764732 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.764788 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260811 02:32:26.765309 21914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.760624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38128 (local address 127.17.79.3:39501)
0811 02:32:26.760838 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.760842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.761274 (+ 432us) server_negotiation.cc:407] Connection header received
0811 02:32:26.761318 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.761320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.761336 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.761414 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:26.761552 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.762589 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.763826 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.764321 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.764405 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.764461 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.765204 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.765239 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":109,"threads_started":1}
I20260811 02:32:26.764775 21906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.760353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:45965 (local address 127.0.0.1:49286)
0811 02:32:26.760461 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.760501 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.760583 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.760918 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.760922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.760925 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:26.761002 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.761004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.762366 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.762368 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.763670 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.763673 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.764523 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.764524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.764596 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.764600 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.764659 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.764692 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":66,"threads_started":1}
I20260811 02:32:26.764914 21907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.760372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37243 (local address 127.0.0.1:60508)
0811 02:32:26.761016 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.761036 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.761089 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.761332 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.761333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.761335 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:26.761379 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.761380 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.762444 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.762445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.763481 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.763484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.764504 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.764506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.764571 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.764575 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.764624 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.764672 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":23,"thread_start_us":108,"threads_started":1}
I20260811 02:32:26.766305 21752 tablet_service.cc:1467] Processing CreateTablet for tablet c2216939aedf46b7960cfc764e2bf45b (DEFAULT_TABLE table=test-table [id=f7413125841c4bde91b72ac3e866f003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:26.766394 21245 tablet_service.cc:1467] Processing CreateTablet for tablet c2216939aedf46b7960cfc764e2bf45b (DEFAULT_TABLE table=test-table [id=f7413125841c4bde91b72ac3e866f003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:26.766453 21502 tablet_service.cc:1467] Processing CreateTablet for tablet c2216939aedf46b7960cfc764e2bf45b (DEFAULT_TABLE table=test-table [id=f7413125841c4bde91b72ac3e866f003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:26.766655 21752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2216939aedf46b7960cfc764e2bf45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:26.766750 21245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2216939aedf46b7960cfc764e2bf45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:26.766752 21502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2216939aedf46b7960cfc764e2bf45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:26.769515 21915 tablet_bootstrap.cc:492] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Bootstrap starting.
I20260811 02:32:26.770655 21918 tablet_bootstrap.cc:492] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Bootstrap starting.
I20260811 02:32:26.770687 21915 tablet_bootstrap.cc:654] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:26.770889 21919 tablet_bootstrap.cc:492] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Bootstrap starting.
I20260811 02:32:26.771034 21915 log.cc:824] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:26.771513 21919 tablet_bootstrap.cc:654] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:26.771859 21919 log.cc:824] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:26.772125 21915 tablet_bootstrap.cc:492] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: No bootstrap required, opened a new log
I20260811 02:32:26.772213 21915 ts_tablet_manager.cc:1397] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 02:32:26.772572 21918 tablet_bootstrap.cc:654] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:26.772894 21918 log.cc:824] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:26.773699 21918 tablet_bootstrap.cc:492] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: No bootstrap required, opened a new log
I20260811 02:32:26.773778 21918 ts_tablet_manager.cc:1397] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:26.774588 21919 tablet_bootstrap.cc:492] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: No bootstrap required, opened a new log
I20260811 02:32:26.774504 21915 raft_consensus.cc:348] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.774674 21919 ts_tablet_manager.cc:1397] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 02:32:26.774672 21915 raft_consensus.cc:374] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:26.774711 21915 raft_consensus.cc:729] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Initialized, Role: FOLLOWER
I20260811 02:32:26.774883 21915 consensus_queue.cc:260] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.775205 21915 ts_tablet_manager.cc:1428] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:26.775230 21869 heartbeater.cc:503] Master 127.17.79.62:38097 was elected leader, sending a full tablet report...
I20260811 02:32:26.775789 21918 raft_consensus.cc:348] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.775935 21918 raft_consensus.cc:374] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:26.775972 21918 raft_consensus.cc:729] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667238ce1ca24e9f9477d57cf2ce2104, State: Initialized, Role: FOLLOWER
I20260811 02:32:26.776101 21918 consensus_queue.cc:260] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.776392 21918 ts_tablet_manager.cc:1428] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 02:32:26.776569 21622 heartbeater.cc:503] Master 127.17.79.62:38097 was elected leader, sending a full tablet report...
I20260811 02:32:26.776979 21919 raft_consensus.cc:348] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.777158 21919 raft_consensus.cc:374] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:26.777210 21919 raft_consensus.cc:729] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf9f198db3143cbb02f7c1b7d76c203, State: Initialized, Role: FOLLOWER
I20260811 02:32:26.777355 21919 consensus_queue.cc:260] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.777652 21919 ts_tablet_manager.cc:1428] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:26.777709 21361 heartbeater.cc:503] Master 127.17.79.62:38097 was elected leader, sending a full tablet report...
W20260811 02:32:26.803879 21623 tablet.cc:2369] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:32:26.890674 21366 tablet.cc:2369] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:26.949316 21927 raft_consensus.cc:482] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:26.949445 21927 raft_consensus.cc:504] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.949770 21927 leader_election.cc:288] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501)
I20260811 02:32:26.952857 21435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.949991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:45965 (local address 127.17.79.2:36105)
0811 02:32:26.950060 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.950074 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.950145 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.950386 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.950387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.950389 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:26.950469 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.950472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.951164 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.951165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.952013 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.952016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.952571 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.952573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.952656 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.952659 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.952733 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.952769 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":31}
I20260811 02:32:26.952847 21914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.950147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:44555 (local address 127.17.79.3:39501)
0811 02:32:26.950194 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.950196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.950362 (+ 166us) server_negotiation.cc:407] Connection header received
0811 02:32:26.950394 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.950395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.950408 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.950486 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:26.950677 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.951173 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.952115 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.952476 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.952564 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.952575 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.952725 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.952767 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:32:26.952863 21912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.950112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:36105 (local address 127.17.79.1:45965)
0811 02:32:26.950165 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:26.950167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:26.950179 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:26.950212 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:26.950213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:26.950247 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:26.950332 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:26.950552 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.951079 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.952127 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.952478 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.952563 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.952575 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:26.952757 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 02:32:26.952799 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:32:26.952879 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:26.949991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39501 (local address 127.17.79.2:44555)
0811 02:32:26.950265 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:26.950275 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:26.950332 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:26.950494 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:26.950495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:26.950496 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:26.950600 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.950602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.951254 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.951255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.952014 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:26.952016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:26.952568 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:26.952569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:26.952647 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:26.952650 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:26.952694 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 02:32:26.952758 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":93,"thread_start_us":102,"threads_started":1}
I20260811 02:32:26.953284 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2216939aedf46b7960cfc764e2bf45b" candidate_uuid: "667238ce1ca24e9f9477d57cf2ce2104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" is_pre_election: true
I20260811 02:32:26.953470 21280 raft_consensus.cc:2454] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667238ce1ca24e9f9477d57cf2ce2104 in term 0.
I20260811 02:32:26.953475 21796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2216939aedf46b7960cfc764e2bf45b" candidate_uuid: "667238ce1ca24e9f9477d57cf2ce2104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" is_pre_election: true
I20260811 02:32:26.953617 21796 raft_consensus.cc:2454] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667238ce1ca24e9f9477d57cf2ce2104 in term 0.
I20260811 02:32:26.953752 21415 leader_election.cc:302] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667238ce1ca24e9f9477d57cf2ce2104, bdf9f198db3143cbb02f7c1b7d76c203; no voters:
I20260811 02:32:26.953886 21927 raft_consensus.cc:2781] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:26.953945 21927 raft_consensus.cc:482] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:26.953975 21927 raft_consensus.cc:3037] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:26.954952 21927 raft_consensus.cc:504] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.955134 21927 leader_election.cc:288] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [CANDIDATE]: Term 1 election: Requested vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501)
I20260811 02:32:26.955282 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2216939aedf46b7960cfc764e2bf45b" candidate_uuid: "667238ce1ca24e9f9477d57cf2ce2104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203"
I20260811 02:32:26.955346 21796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2216939aedf46b7960cfc764e2bf45b" candidate_uuid: "667238ce1ca24e9f9477d57cf2ce2104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15"
I20260811 02:32:26.955405 21280 raft_consensus.cc:3037] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:26.955417 21796 raft_consensus.cc:3037] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:26.956331 21280 raft_consensus.cc:2454] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667238ce1ca24e9f9477d57cf2ce2104 in term 1.
I20260811 02:32:26.956343 21796 raft_consensus.cc:2454] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 667238ce1ca24e9f9477d57cf2ce2104 in term 1.
I20260811 02:32:26.956517 21415 leader_election.cc:302] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667238ce1ca24e9f9477d57cf2ce2104, bdf9f198db3143cbb02f7c1b7d76c203; no voters:
I20260811 02:32:26.956633 21927 raft_consensus.cc:2781] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:26.956781 21927 raft_consensus.cc:686] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 LEADER]: Becoming Leader. State: Replica: 667238ce1ca24e9f9477d57cf2ce2104, State: Running, Role: LEADER
I20260811 02:32:26.956900 21927 consensus_queue.cc:237] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } }
I20260811 02:32:26.957801 20973 catalog_manager.cc:5495] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "667238ce1ca24e9f9477d57cf2ce2104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } health_report { overall_health: HEALTHY } } }
W20260811 02:32:26.972317 21871 tablet.cc:2369] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 02:32:27 dist-test-slave-7nm7 krb5kdc[20879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415546, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:27.018172 21946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.011143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38097 (local address 127.0.0.1:46610)
0811 02:32:27.011374 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:27.011384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:27.011481 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:27.011656 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:27.011657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:27.011986 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:27.012031 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.012033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.012703 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.012704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.013224 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.013225 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.013596 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.013597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.013653 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.014226 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:27.014251 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:27.015742 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:27.017178 (+ 1436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:27.017185 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:27.017187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:27.017405 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:27.017596 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:27.017597 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:27.017597 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:27.017654 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:27.017878 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:27.017884 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:27.017929 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 02:32:27.017982 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 02:32:27.018081 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":132,"threads_started":1}
I20260811 02:32:27.018344 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.011217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46610 (local address 127.17.79.62:38097)
0811 02:32:27.011318 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.011320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.011461 (+ 141us) server_negotiation.cc:407] Connection header received
0811 02:32:27.011559 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.011559 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.011571 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.011651 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:27.012123 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.012613 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.013313 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.013491 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.013597 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.015835 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:27.015837 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:27.015837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:27.015844 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:27.017077 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:27.017481 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:27.017482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:27.017482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:27.017533 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:27.017722 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:27.017723 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:27.017723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:27.017822 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:27.017874 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.018013 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.018157 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":67}
I20260811 02:32:27.020646 20973 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:46610:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 02:32:27.020874 20973 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:27.022447 21245 tablet_service.cc:1467] Processing CreateTablet for tablet e075a8280be447708ef0fbf7d44eb139 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b6e2b4b6957c492d8e3a14ef1aee70c1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:27.022466 21752 tablet_service.cc:1467] Processing CreateTablet for tablet e075a8280be447708ef0fbf7d44eb139 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b6e2b4b6957c492d8e3a14ef1aee70c1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:27.022627 21245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e075a8280be447708ef0fbf7d44eb139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:27.022648 21752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e075a8280be447708ef0fbf7d44eb139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:27.023880 21915 tablet_bootstrap.cc:492] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: Bootstrap starting.
I20260811 02:32:27.023943 21919 tablet_bootstrap.cc:492] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: Bootstrap starting.
I20260811 02:32:27.024025 21502 tablet_service.cc:1467] Processing CreateTablet for tablet e075a8280be447708ef0fbf7d44eb139 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b6e2b4b6957c492d8e3a14ef1aee70c1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:27.024196 21502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e075a8280be447708ef0fbf7d44eb139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:27.024365 21919 tablet_bootstrap.cc:654] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:27.024497 21915 tablet_bootstrap.cc:654] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:27.025079 21919 tablet_bootstrap.cc:492] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: No bootstrap required, opened a new log
I20260811 02:32:27.025142 21919 ts_tablet_manager.cc:1397] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:27.025309 21919 raft_consensus.cc:348] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.025386 21919 raft_consensus.cc:374] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:27.025408 21919 raft_consensus.cc:729] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf9f198db3143cbb02f7c1b7d76c203, State: Initialized, Role: FOLLOWER
I20260811 02:32:27.025447 21919 consensus_queue.cc:260] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.025584 21919 ts_tablet_manager.cc:1428] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:27.025671 21930 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.025784 21930 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:27.025897 21918 tablet_bootstrap.cc:492] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: Bootstrap starting.
I20260811 02:32:27.026365 21918 tablet_bootstrap.cc:654] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:27.026407 21915 tablet_bootstrap.cc:492] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: No bootstrap required, opened a new log
I20260811 02:32:27.026451 21915 ts_tablet_manager.cc:1397] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 02:32:27.026612 21915 raft_consensus.cc:348] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.026702 21915 raft_consensus.cc:374] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:27.026729 21915 raft_consensus.cc:729] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Initialized, Role: FOLLOWER
I20260811 02:32:27.026779 21915 consensus_queue.cc:260] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.026904 21915 ts_tablet_manager.cc:1428] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:27.027004 21925 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.027117 21925 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:27.027371 21918 tablet_bootstrap.cc:492] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: No bootstrap required, opened a new log
I20260811 02:32:27.027428 21918 ts_tablet_manager.cc:1397] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 02:32:27.027572 21918 raft_consensus.cc:348] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.027668 21918 raft_consensus.cc:374] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:27.027701 21918 raft_consensus.cc:729] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667238ce1ca24e9f9477d57cf2ce2104, State: Initialized, Role: FOLLOWER
I20260811 02:32:27.027753 21918 consensus_queue.cc:260] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.027844 21918 ts_tablet_manager.cc:1428] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:27.027886 21927 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.027959 21927 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:27.112341 21925 raft_consensus.cc:482] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:27.112452 21925 raft_consensus.cc:504] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.112872 21925 leader_election.cc:288] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243)
I20260811 02:32:27.116221 21912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.113188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:54147 (local address 127.17.79.1:45965)
0811 02:32:27.113255 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.113257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.113267 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:27.113303 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.113304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.113315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.113400 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:27.113613 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.114141 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.115349 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.115843 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.115900 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.115908 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.116136 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.116166 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 02:32:27.116272 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.113101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:45965 (local address 127.17.79.3:54147)
0811 02:32:27.113174 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:27.113187 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:27.113237 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:27.113431 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:27.113432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:27.113435 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:27.113524 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.113527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.114259 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.114260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.115233 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.115236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.115937 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.115938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.116025 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.116030 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:27.116127 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 02:32:27.116170 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":104}
I20260811 02:32:27.116523 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e075a8280be447708ef0fbf7d44eb139" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" is_pre_election: true
I20260811 02:32:27.116586 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.113189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:52781 (local address 127.17.79.2:37243)
0811 02:32:27.113237 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.113240 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.113416 (+ 176us) server_negotiation.cc:407] Connection header received
0811 02:32:27.113452 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.113453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.113466 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.113528 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:27.113746 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.114310 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.115696 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.116197 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.116266 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.116277 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.116484 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.116531 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:27.116626 21280 raft_consensus.cc:2454] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 0.
I20260811 02:32:27.116852 21663 leader_election.cc:302] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf9f198db3143cbb02f7c1b7d76c203, ffe16dc60f3747539b08f9e7dfa0cb15; no voters:
I20260811 02:32:27.116995 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.113101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37243 (local address 127.17.79.3:52781)
0811 02:32:27.113320 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:27.113332 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:27.113397 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:27.113539 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:27.113540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:27.113541 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:27.113645 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.113646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.114435 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.114437 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.115587 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.115591 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.116288 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.116289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.116371 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.116377 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:32:27.116685 (+ 308us) client_negotiation.cc:240] Negotiation successful
0811 02:32:27.116822 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":22,"thread_start_us":141,"threads_started":1}
I20260811 02:32:27.117046 21925 raft_consensus.cc:2781] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:27.117143 21925 raft_consensus.cc:482] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:27.117185 21925 raft_consensus.cc:3037] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:27.117411 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e075a8280be447708ef0fbf7d44eb139" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104" is_pre_election: true
I20260811 02:32:27.117534 21537 raft_consensus.cc:2454] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 0.
I20260811 02:32:27.118041 21925 raft_consensus.cc:504] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.118412 21925 leader_election.cc:288] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 election: Requested vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243)
I20260811 02:32:27.118573 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e075a8280be447708ef0fbf7d44eb139" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104"
I20260811 02:32:27.118659 21537 raft_consensus.cc:3037] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:27.118501 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e075a8280be447708ef0fbf7d44eb139" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203"
I20260811 02:32:27.118736 21280 raft_consensus.cc:3037] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:27.119287 21537 raft_consensus.cc:2454] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 1.
I20260811 02:32:27.119379 21280 raft_consensus.cc:2454] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 1.
I20260811 02:32:27.119483 21665 leader_election.cc:302] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667238ce1ca24e9f9477d57cf2ce2104, ffe16dc60f3747539b08f9e7dfa0cb15; no voters:
I20260811 02:32:27.119572 21925 raft_consensus.cc:2781] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:27.119729 21925 raft_consensus.cc:686] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 LEADER]: Becoming Leader. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Running, Role: LEADER
I20260811 02:32:27.119843 21925 consensus_queue.cc:237] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.120273 21954 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: TxnStatusTablet state changed. Reason: New leader ffe16dc60f3747539b08f9e7dfa0cb15. Latest consensus state: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.120368 21954 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:27.120569 21957 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 02:32:27.120697 21957 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 02:32:27.120698 20973 catalog_manager.cc:5495] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3). New cstate: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260811 02:32:27.147450 21946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.144232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39501 (local address 127.0.0.1:38130)
0811 02:32:27.144317 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:27.144332 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:27.144385 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:27.144575 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:27.144576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:27.144577 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:27.144631 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.144633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.145624 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.145625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.146397 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.146400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.146889 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.146890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.146948 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.146965 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.147281 (+ 316us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.147293 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 02:32:27.147336 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 02:32:27.147381 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:32:27.147469 21914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.144312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38130 (local address 127.17.79.3:39501)
0811 02:32:27.144362 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.144364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.144376 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:27.144471 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.144472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.144497 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.144564 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:27.144695 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.145508 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.146489 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.146794 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.146869 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.147078 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.147204 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.147289 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.147342 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.147365 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:27.149487 21280 raft_consensus.cc:1261] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Refusing update from remote peer ffe16dc60f3747539b08f9e7dfa0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:27.149547 21537 raft_consensus.cc:1261] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Refusing update from remote peer ffe16dc60f3747539b08f9e7dfa0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:27.149892 21925 consensus_queue.cc:1035] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:27.150031 21954 consensus_queue.cc:1035] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:27.151186 21927 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: TxnStatusTablet state changed. Reason: New leader ffe16dc60f3747539b08f9e7dfa0cb15. Latest consensus state: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.151289 21927 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:27.152364 21930 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: TxnStatusTablet state changed. Reason: New leader ffe16dc60f3747539b08f9e7dfa0cb15. Latest consensus state: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.152459 21930 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:27.153086 21954 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.153183 21954 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:27.153667 21961 mvcc.cc:205] Tried to move back new op lower bound from 7317158081121484800 to 7317158081003405312. Current Snapshot: MvccSnapshot[applied={T|T < 7317158081121484800}]
I20260811 02:32:27.153831 21927 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.153836 21925 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.153903 21927 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P 667238ce1ca24e9f9477d57cf2ce2104: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:27.153903 21925 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P ffe16dc60f3747539b08f9e7dfa0cb15: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:27.154696 21930 tablet_replica.cc:439] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } } }
I20260811 02:32:27.154791 21930 tablet_replica.cc:442] T e075a8280be447708ef0fbf7d44eb139 P bdf9f198db3143cbb02f7c1b7d76c203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:27.157967 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.155577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60518 (local address 127.17.79.2:37243)
0811 02:32:27.155645 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.155647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.155654 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:27.155691 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.155691 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.155706 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.155783 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:27.155923 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.156400 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.157170 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.157382 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.157458 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.157633 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.157732 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.157816 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.157866 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.157890 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:32:27.164019 21977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.161271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39501 (local address 127.17.79.2:59325)
0811 02:32:27.161438 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:27.161448 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:27.161509 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:27.161638 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:27.161639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:27.161640 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:27.161700 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.161701 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.162579 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.162580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.163147 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.163148 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.163615 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.163616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.163677 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.163691 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.163884 (+ 193us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.163886 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:27.163918 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 02:32:27.163955 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260811 02:32:27.164021 21914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.161337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:59325 (local address 127.17.79.3:39501)
0811 02:32:27.161380 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.161382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.161515 (+ 133us) server_negotiation.cc:407] Connection header received
0811 02:32:27.161545 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.161546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.161567 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.161634 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:27.161757 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.162487 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.163226 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.163524 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.163604 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.163784 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.163817 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.163874 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.163930 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.163949 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:27.166766 21796 raft_consensus.cc:1261] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Refusing update from remote peer 667238ce1ca24e9f9477d57cf2ce2104: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:27.167099 21927 consensus_queue.cc:1035] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:27.169417 21960 mvcc.cc:205] Tried to move back new op lower bound from 7317158081192775680 to 7317158080336138240. Current Snapshot: MvccSnapshot[applied={T|T < 7317158081192775680}]
I20260811 02:32:27.170096 21280 raft_consensus.cc:1261] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Refusing update from remote peer 667238ce1ca24e9f9477d57cf2ce2104: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:27.170321 21927 consensus_queue.cc:1035] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:27.171221 21963 mvcc.cc:205] Tried to move back new op lower bound from 7317158081202503680 to 7317158080336138240. Current Snapshot: MvccSnapshot[applied={T|T < 7317158081202503680}]
I20260811 02:32:27.177471 21882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.174413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37243 (local address 127.17.79.3:56669)
0811 02:32:27.174556 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:27.174567 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:27.174613 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:27.174757 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:27.174758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:27.174759 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:27.174837 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.174839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.175748 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.175749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.176454 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.176457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.176818 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.176820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.176891 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.176909 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.177268 (+ 359us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.177270 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:27.177324 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 02:32:27.177368 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 02:32:27.177650 21913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.174473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:56669 (local address 127.17.79.2:37243)
0811 02:32:27.174513 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.174516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.174666 (+ 150us) server_negotiation.cc:407] Connection header received
0811 02:32:27.174691 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.174692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.174703 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.174754 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:27.174916 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.175666 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.176522 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.176732 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.176808 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.176998 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.177034 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.177223 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.177568 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.177589 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:32:27.192202 20973 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:27.192376 20973 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:27.193297 20973 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Sending DeleteTablet for 3 replicas of tablet c2216939aedf46b7960cfc764e2bf45b
I20260811 02:32:27.193662 21245 tablet_service.cc:1514] Processing DeleteTablet for tablet c2216939aedf46b7960cfc764e2bf45b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:27 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:49286
I20260811 02:32:27.193678 21752 tablet_service.cc:1514] Processing DeleteTablet for tablet c2216939aedf46b7960cfc764e2bf45b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:27 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:38128
I20260811 02:32:27.193915 21995 tablet_replica.cc:330] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: stopping tablet replica
I20260811 02:32:27.194018 21995 raft_consensus.cc:2229] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:27.194073 21995 raft_consensus.cc:2258] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:27.194165 21502 tablet_service.cc:1514] Processing DeleteTablet for tablet c2216939aedf46b7960cfc764e2bf45b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:27 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:60508
I20260811 02:32:27.194492 22001 tablet_replica.cc:330] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: stopping tablet replica
I20260811 02:32:27.194619 22001 raft_consensus.cc:2229] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:27.194720 22001 raft_consensus.cc:2258] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:27.194774 21995 ts_tablet_manager.cc:1905] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:27.194892 20973 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:27.195050 20973 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:27.195688 22001 ts_tablet_manager.cc:1905] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:27.196273 21502 tablet_service.cc:1467] Processing CreateTablet for tablet f97444069c434ed4bb58a95118e5d047 (DEFAULT_TABLE table=test-table [id=ab04834ef7614e088694894f64e6096c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:27.196333 21752 tablet_service.cc:1467] Processing CreateTablet for tablet f97444069c434ed4bb58a95118e5d047 (DEFAULT_TABLE table=test-table [id=ab04834ef7614e088694894f64e6096c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:27.196422 21502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f97444069c434ed4bb58a95118e5d047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:27.196522 21752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f97444069c434ed4bb58a95118e5d047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:27.196537 21995 ts_tablet_manager.cc:1918] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:27.196611 21995 log.cc:1196] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/c2216939aedf46b7960cfc764e2bf45b
I20260811 02:32:27.196870 21995 ts_tablet_manager.cc:1939] T c2216939aedf46b7960cfc764e2bf45b P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting consensus metadata
I20260811 02:32:27.197304 20944 catalog_manager.cc:4841] TS ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501): tablet c2216939aedf46b7960cfc764e2bf45b (table test-table [id=f7413125841c4bde91b72ac3e866f003]) successfully deleted
I20260811 02:32:27.197506 22001 ts_tablet_manager.cc:1918] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:27.197568 22001 log.cc:1196] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/c2216939aedf46b7960cfc764e2bf45b
I20260811 02:32:27.197749 21915 tablet_bootstrap.cc:492] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: Bootstrap starting.
I20260811 02:32:27.197801 21918 tablet_bootstrap.cc:492] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: Bootstrap starting.
I20260811 02:32:27.197844 22001 ts_tablet_manager.cc:1939] T c2216939aedf46b7960cfc764e2bf45b P 667238ce1ca24e9f9477d57cf2ce2104: Deleting consensus metadata
I20260811 02:32:27.198082 21915 tablet_bootstrap.cc:654] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:27.198189 21918 tablet_bootstrap.cc:654] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:27.198576 21245 tablet_service.cc:1467] Processing CreateTablet for tablet f97444069c434ed4bb58a95118e5d047 (DEFAULT_TABLE table=test-table [id=ab04834ef7614e088694894f64e6096c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:27.198644 21915 tablet_bootstrap.cc:492] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: No bootstrap required, opened a new log
I20260811 02:32:27.198686 21915 ts_tablet_manager.cc:1397] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:27.198712 21245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f97444069c434ed4bb58a95118e5d047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:27.198835 21915 raft_consensus.cc:348] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.198902 21915 raft_consensus.cc:374] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:27.198921 21915 raft_consensus.cc:729] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Initialized, Role: FOLLOWER
I20260811 02:32:27.198967 21915 consensus_queue.cc:260] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.199048 21915 ts_tablet_manager.cc:1428] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:27.200083 20943 catalog_manager.cc:4841] TS 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243): tablet c2216939aedf46b7960cfc764e2bf45b (table test-table [id=f7413125841c4bde91b72ac3e866f003]) successfully deleted
I20260811 02:32:27.200304 21919 tablet_bootstrap.cc:492] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: Bootstrap starting.
I20260811 02:32:27.200783 21919 tablet_bootstrap.cc:654] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:27.201717 21918 tablet_bootstrap.cc:492] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: No bootstrap required, opened a new log
I20260811 02:32:27.201773 21918 ts_tablet_manager.cc:1397] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 02:32:27.201944 21918 raft_consensus.cc:348] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.202003 21919 tablet_bootstrap.cc:492] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: No bootstrap required, opened a new log
I20260811 02:32:27.202015 21918 raft_consensus.cc:374] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:27.202039 21918 raft_consensus.cc:729] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667238ce1ca24e9f9477d57cf2ce2104, State: Initialized, Role: FOLLOWER
I20260811 02:32:27.202059 21919 ts_tablet_manager.cc:1397] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:27.202080 21918 consensus_queue.cc:260] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.202178 21918 ts_tablet_manager.cc:1428] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:27.202199 21919 raft_consensus.cc:348] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.202680 21919 raft_consensus.cc:374] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:27.202714 21919 raft_consensus.cc:729] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf9f198db3143cbb02f7c1b7d76c203, State: Initialized, Role: FOLLOWER
I20260811 02:32:27.202756 21919 consensus_queue.cc:260] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.202858 21919 ts_tablet_manager.cc:1428] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:27.203372 21999 tablet_replica.cc:330] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: stopping tablet replica
I20260811 02:32:27.203495 21999 raft_consensus.cc:2229] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:27.203583 21999 raft_consensus.cc:2258] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:27.203958 21999 ts_tablet_manager.cc:1905] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:27.205355 21999 ts_tablet_manager.cc:1918] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:27.205447 21999 log.cc:1196] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/c2216939aedf46b7960cfc764e2bf45b
I20260811 02:32:27.205724 21999 ts_tablet_manager.cc:1939] T c2216939aedf46b7960cfc764e2bf45b P bdf9f198db3143cbb02f7c1b7d76c203: Deleting consensus metadata
I20260811 02:32:27.206108 20940 catalog_manager.cc:4841] TS bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965): tablet c2216939aedf46b7960cfc764e2bf45b (table test-table [id=f7413125841c4bde91b72ac3e866f003]) successfully deleted
I20260811 02:32:27.357560 21988 raft_consensus.cc:482] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:27.357692 21988 raft_consensus.cc:504] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.357919 21988 leader_election.cc:288] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243)
I20260811 02:32:27.358179 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f97444069c434ed4bb58a95118e5d047" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" is_pre_election: true
I20260811 02:32:27.358201 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f97444069c434ed4bb58a95118e5d047" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104" is_pre_election: true
I20260811 02:32:27.358310 21280 raft_consensus.cc:2454] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 0.
I20260811 02:32:27.358317 21537 raft_consensus.cc:2454] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 0.
I20260811 02:32:27.358568 21663 leader_election.cc:302] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf9f198db3143cbb02f7c1b7d76c203, ffe16dc60f3747539b08f9e7dfa0cb15; no voters:
I20260811 02:32:27.358712 21988 raft_consensus.cc:2781] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:27.358800 21988 raft_consensus.cc:482] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:27.358831 21988 raft_consensus.cc:3037] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:27.359877 21988 raft_consensus.cc:504] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.360037 21988 leader_election.cc:288] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 election: Requested vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243)
I20260811 02:32:27.360227 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f97444069c434ed4bb58a95118e5d047" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203"
I20260811 02:32:27.360248 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f97444069c434ed4bb58a95118e5d047" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104"
I20260811 02:32:27.360323 21537 raft_consensus.cc:3037] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:27.360335 21280 raft_consensus.cc:3037] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:27.361088 21537 raft_consensus.cc:2454] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 1.
I20260811 02:32:27.361088 21280 raft_consensus.cc:2454] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 1.
I20260811 02:32:27.361266 21663 leader_election.cc:302] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf9f198db3143cbb02f7c1b7d76c203, ffe16dc60f3747539b08f9e7dfa0cb15; no voters:
I20260811 02:32:27.361413 21988 raft_consensus.cc:2781] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:27.361502 21988 raft_consensus.cc:686] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 LEADER]: Becoming Leader. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Running, Role: LEADER
I20260811 02:32:27.361589 21988 consensus_queue.cc:237] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:27.362147 20973 catalog_manager.cc:5495] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3). New cstate: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260811 02:32:27.386475 21914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.384191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38146 (local address 127.17.79.3:39501)
0811 02:32:27.384238 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.384240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.384250 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:27.384340 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.384341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.384351 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.384393 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:27.384518 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.384995 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.385732 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.385956 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.386032 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.386180 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.386213 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.386303 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.386375 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.386393 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:32:27.391070 21882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.388648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39501 (local address 127.17.79.3:53091)
0811 02:32:27.388706 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:27.388718 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:27.388761 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:27.388867 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:27.388867 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:27.388868 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:27.388899 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.388900 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.389508 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.389509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.390031 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:27.390033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.390694 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.390695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:27.390746 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.390750 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.390936 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.390938 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:27.390973 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 02:32:27.391007 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 02:32:27.391081 21914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:27.388722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:53091 (local address 127.17.79.3:39501)
0811 02:32:27.388777 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:27.388779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:27.388788 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:27.388813 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:27.388814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:27.388821 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:27.388865 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:27.388942 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.389427 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.390305 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:27.390596 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:27.390685 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:27.390837 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:27.390872 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:27.390928 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:27.390975 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 02:32:27.390993 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 02:32:27.393253 21537 raft_consensus.cc:1261] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Refusing update from remote peer ffe16dc60f3747539b08f9e7dfa0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:27.393334 21280 raft_consensus.cc:1261] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Refusing update from remote peer ffe16dc60f3747539b08f9e7dfa0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:27.393553 21954 consensus_queue.cc:1035] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:27.393893 21988 consensus_queue.cc:1035] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 02:32:27.398690 21960 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 02:32:28.921098 20971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:28.921200 20971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:28.922005 20971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Sending DeleteTablet for 3 replicas of tablet f97444069c434ed4bb58a95118e5d047
I20260811 02:32:28.922279 21245 tablet_service.cc:1514] Processing DeleteTablet for tablet f97444069c434ed4bb58a95118e5d047 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:28 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:49286
I20260811 02:32:28.922295 21502 tablet_service.cc:1514] Processing DeleteTablet for tablet f97444069c434ed4bb58a95118e5d047 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:28 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:60508
I20260811 02:32:28.922303 21750 tablet_service.cc:1514] Processing DeleteTablet for tablet f97444069c434ed4bb58a95118e5d047 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:28 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:38128
I20260811 02:32:28.922484 22054 tablet_replica.cc:330] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: stopping tablet replica
I20260811 02:32:28.922508 22056 tablet_replica.cc:330] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: stopping tablet replica
I20260811 02:32:28.922544 22054 raft_consensus.cc:2229] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:28.922566 22056 raft_consensus.cc:2229] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:28.922695 22056 raft_consensus.cc:2258] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:28.922736 22055 tablet_replica.cc:330] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: stopping tablet replica
I20260811 02:32:28.922811 22055 raft_consensus.cc:2229] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:28.922865 22055 raft_consensus.cc:2258] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:28.922587 22054 raft_consensus.cc:2258] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:28.922997 22056 ts_tablet_manager.cc:1905] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:28.923200 22055 ts_tablet_manager.cc:1905] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:28.924916 22055 ts_tablet_manager.cc:1918] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 02:32:28.924940 22056 ts_tablet_manager.cc:1918] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 02:32:28.924990 22056 log.cc:1196] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/f97444069c434ed4bb58a95118e5d047
I20260811 02:32:28.925019 22055 log.cc:1196] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/f97444069c434ed4bb58a95118e5d047
I20260811 02:32:28.925274 22056 ts_tablet_manager.cc:1939] T f97444069c434ed4bb58a95118e5d047 P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting consensus metadata
I20260811 02:32:28.925274 22055 ts_tablet_manager.cc:1939] T f97444069c434ed4bb58a95118e5d047 P 667238ce1ca24e9f9477d57cf2ce2104: Deleting consensus metadata
I20260811 02:32:28.925578 20943 catalog_manager.cc:4841] TS 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243): tablet f97444069c434ed4bb58a95118e5d047 (table test-table [id=ab04834ef7614e088694894f64e6096c]) successfully deleted
I20260811 02:32:28.925616 20944 catalog_manager.cc:4841] TS ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501): tablet f97444069c434ed4bb58a95118e5d047 (table test-table [id=ab04834ef7614e088694894f64e6096c]) successfully deleted
I20260811 02:32:28.925949 22054 ts_tablet_manager.cc:1905] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:28.927383 22054 ts_tablet_manager.cc:1918] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 02:32:28.927438 22054 log.cc:1196] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/f97444069c434ed4bb58a95118e5d047
I20260811 02:32:28.927675 22054 ts_tablet_manager.cc:1939] T f97444069c434ed4bb58a95118e5d047 P bdf9f198db3143cbb02f7c1b7d76c203: Deleting consensus metadata
I20260811 02:32:28.928000 20940 catalog_manager.cc:4841] TS bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965): tablet f97444069c434ed4bb58a95118e5d047 (table test-table [id=ab04834ef7614e088694894f64e6096c]) successfully deleted
Aug 11 02:32:28 dist-test-slave-7nm7 krb5kdc[20879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 02:32:28 dist-test-slave-7nm7 krb5kdc[20879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415548, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:28.951087 22069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:28.943520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46616 (local address 127.17.79.62:38097)
0811 02:32:28.943773 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:28.943775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:28.943802 (+ 27us) server_negotiation.cc:407] Connection header received
0811 02:32:28.943829 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:28.943830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:28.943841 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:28.943907 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:28.944488 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:28.945045 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:28.945853 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:28.946052 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:28.946124 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:28.948590 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:28.948592 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:28.948592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:28.948599 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:28.949968 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:28.950401 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:28.950402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:28.950402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:28.950455 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:28.950644 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:28.950645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:28.950645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:28.950746 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:28.950823 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:28.950926 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 02:32:28.950988 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":192,"threads_started":1}
I20260811 02:32:28.952844 20971 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:28.953014 20971 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:28.954483 21245 tablet_service.cc:1467] Processing CreateTablet for tablet 1a826a6200f64fa8a9ae75fffe0e3d19 (DEFAULT_TABLE table=test-table [id=546c771027154fc79b3e154105912d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:28.954550 21750 tablet_service.cc:1467] Processing CreateTablet for tablet 1a826a6200f64fa8a9ae75fffe0e3d19 (DEFAULT_TABLE table=test-table [id=546c771027154fc79b3e154105912d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:28.954532 21502 tablet_service.cc:1467] Processing CreateTablet for tablet 1a826a6200f64fa8a9ae75fffe0e3d19 (DEFAULT_TABLE table=test-table [id=546c771027154fc79b3e154105912d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:28.954643 21245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a826a6200f64fa8a9ae75fffe0e3d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:28.954675 21750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a826a6200f64fa8a9ae75fffe0e3d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:28.954698 21502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a826a6200f64fa8a9ae75fffe0e3d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:28.956034 22070 tablet_bootstrap.cc:492] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: Bootstrap starting.
I20260811 02:32:28.956238 22075 tablet_bootstrap.cc:492] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: Bootstrap starting.
I20260811 02:32:28.956430 22070 tablet_bootstrap.cc:654] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:28.956487 22071 tablet_bootstrap.cc:492] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: Bootstrap starting.
I20260811 02:32:28.956637 22075 tablet_bootstrap.cc:654] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:28.956852 22071 tablet_bootstrap.cc:654] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:28.957199 22070 tablet_bootstrap.cc:492] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: No bootstrap required, opened a new log
I20260811 02:32:28.957249 22070 ts_tablet_manager.cc:1397] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:28.957454 22070 raft_consensus.cc:348] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:28.957522 22071 tablet_bootstrap.cc:492] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: No bootstrap required, opened a new log
I20260811 02:32:28.957544 22070 raft_consensus.cc:374] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:28.957573 22070 raft_consensus.cc:729] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667238ce1ca24e9f9477d57cf2ce2104, State: Initialized, Role: FOLLOWER
I20260811 02:32:28.957561 22071 ts_tablet_manager.cc:1397] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:28.957635 22070 consensus_queue.cc:260] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:28.957726 22071 raft_consensus.cc:348] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:28.957800 22071 raft_consensus.cc:374] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:28.957823 22071 raft_consensus.cc:729] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf9f198db3143cbb02f7c1b7d76c203, State: Initialized, Role: FOLLOWER
I20260811 02:32:28.957861 22070 ts_tablet_manager.cc:1428] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:28.957886 22071 consensus_queue.cc:260] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:28.958055 22071 ts_tablet_manager.cc:1428] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:28.958485 22075 tablet_bootstrap.cc:492] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: No bootstrap required, opened a new log
I20260811 02:32:28.958542 22075 ts_tablet_manager.cc:1397] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:28.958664 22075 raft_consensus.cc:348] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:28.958750 22075 raft_consensus.cc:374] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:28.958776 22075 raft_consensus.cc:729] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Initialized, Role: FOLLOWER
I20260811 02:32:28.958833 22075 consensus_queue.cc:260] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:28.958942 22075 ts_tablet_manager.cc:1428] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:29.162864 22084 raft_consensus.cc:482] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:29.162953 22084 raft_consensus.cc:504] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.163292 22084 leader_election.cc:288] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243), ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501)
I20260811 02:32:29.166677 22090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.163471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37243 (local address 127.17.79.1:52539)
0811 02:32:29.163696 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:29.163708 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:29.163781 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:29.163952 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:29.163953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:29.163955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:29.164039 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.164040 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.164679 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.164680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.165810 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.165812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.166445 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.166446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.166507 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.166512 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:29.166569 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 02:32:29.166603 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":159,"threads_started":1}
I20260811 02:32:29.166719 22092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.163551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:52539 (local address 127.17.79.2:37243)
0811 02:32:29.163698 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:29.163701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:29.163774 (+ 73us) server_negotiation.cc:407] Connection header received
0811 02:32:29.163849 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:29.163850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:29.163867 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:29.163949 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:29.164112 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.164595 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.165900 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.166364 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.166439 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.166452 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:29.166591 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 02:32:29.166636 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260811 02:32:29.167026 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a826a6200f64fa8a9ae75fffe0e3d19" candidate_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104" is_pre_election: true
I20260811 02:32:29.167161 21537 raft_consensus.cc:2454] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf9f198db3143cbb02f7c1b7d76c203 in term 0.
I20260811 02:32:29.167333 22089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.163476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39501 (local address 127.17.79.1:50345)
0811 02:32:29.163709 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:29.163720 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:29.163789 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:29.163958 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:29.163960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:29.163962 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:29.164465 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.164467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.165158 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.165159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.166121 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.166123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.166937 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.166938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.167060 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.167069 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 02:32:29.167162 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 02:32:29.167223 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":157,"threads_started":1}
I20260811 02:32:29.167380 21148 leader_election.cc:302] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667238ce1ca24e9f9477d57cf2ce2104, bdf9f198db3143cbb02f7c1b7d76c203; no voters:
I20260811 02:32:29.167532 22084 raft_consensus.cc:2781] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:29.167577 22084 raft_consensus.cc:482] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:29.167577 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.163529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:50345 (local address 127.17.79.3:39501)
0811 02:32:29.163720 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:29.163722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:29.163783 (+ 61us) server_negotiation.cc:407] Connection header received
0811 02:32:29.163855 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:29.163855 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:29.163867 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:29.163954 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:29.164563 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.165066 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.166201 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.166750 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.166875 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.166890 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:29.167428 (+ 538us) server_negotiation.cc:299] Negotiation successful
0811 02:32:29.167482 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
I20260811 02:32:29.167595 22084 raft_consensus.cc:3037] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:29.167775 21796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a826a6200f64fa8a9ae75fffe0e3d19" candidate_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" is_pre_election: true
I20260811 02:32:29.167860 21796 raft_consensus.cc:2454] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf9f198db3143cbb02f7c1b7d76c203 in term 0.
I20260811 02:32:29.168550 22084 raft_consensus.cc:504] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.168681 22084 leader_election.cc:288] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [CANDIDATE]: Term 1 election: Requested vote from peers 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243), ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501)
I20260811 02:32:29.168838 21796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a826a6200f64fa8a9ae75fffe0e3d19" candidate_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15"
I20260811 02:32:29.168870 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a826a6200f64fa8a9ae75fffe0e3d19" candidate_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104"
I20260811 02:32:29.168924 21796 raft_consensus.cc:3037] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:29.168928 21537 raft_consensus.cc:3037] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:29.169674 21796 raft_consensus.cc:2454] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf9f198db3143cbb02f7c1b7d76c203 in term 1.
I20260811 02:32:29.169674 21537 raft_consensus.cc:2454] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf9f198db3143cbb02f7c1b7d76c203 in term 1.
I20260811 02:32:29.169875 21150 leader_election.cc:302] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf9f198db3143cbb02f7c1b7d76c203, ffe16dc60f3747539b08f9e7dfa0cb15; no voters:
I20260811 02:32:29.169970 22084 raft_consensus.cc:2781] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:29.170135 22084 raft_consensus.cc:686] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 LEADER]: Becoming Leader. State: Replica: bdf9f198db3143cbb02f7c1b7d76c203, State: Running, Role: LEADER
I20260811 02:32:29.170255 22084 consensus_queue.cc:237] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.171027 20974 catalog_manager.cc:5495] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1). New cstate: current_term: 1 leader_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } health_report { overall_health: UNKNOWN } } }
I20260811 02:32:29.188115 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.185836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49298 (local address 127.17.79.1:45965)
0811 02:32:29.185990 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:29.185992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:29.185998 (+ 6us) server_negotiation.cc:407] Connection header received
0811 02:32:29.186028 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:29.186028 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:29.186044 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:29.186120 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:29.186333 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.186782 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.187461 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.187641 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.187692 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.187828 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:29.187919 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:29.187969 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:29.188004 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 02:32:29.188017 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260811 02:32:29.192442 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.190539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:57925 (local address 127.17.79.3:39501)
0811 02:32:29.190572 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:29.190574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:29.190630 (+ 56us) server_negotiation.cc:407] Connection header received
0811 02:32:29.190681 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:29.190681 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:29.190690 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:29.190733 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:29.190830 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.191247 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.191907 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.192073 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.192119 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.192257 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:29.192279 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:29.192315 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:29.192347 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 02:32:29.192362 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 02:32:29.192544 22104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.190412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39501 (local address 127.17.79.1:57925)
0811 02:32:29.190563 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:29.190573 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:29.190630 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:29.190741 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:29.190742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:29.190743 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:29.190783 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.190784 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.191308 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.191308 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.191844 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.191845 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.192133 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.192134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.192180 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.192193 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:29.192316 (+ 123us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:29.192317 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 02:32:29.192347 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 02:32:29.192374 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260811 02:32:29.194558 21537 raft_consensus.cc:1261] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Refusing update from remote peer bdf9f198db3143cbb02f7c1b7d76c203: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:29.194585 21796 raft_consensus.cc:1261] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Refusing update from remote peer bdf9f198db3143cbb02f7c1b7d76c203: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:29.194893 22096 consensus_queue.cc:1035] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:29.195019 22084 consensus_queue.cc:1035] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:29.202165 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.199944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:49985 (local address 127.17.79.1:45965)
0811 02:32:29.199982 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:29.199984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:29.200003 (+ 19us) server_negotiation.cc:407] Connection header received
0811 02:32:29.200023 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:29.200024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:29.200033 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:29.200072 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:29.200191 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.200597 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.201327 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.201585 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.201668 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.201830 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:29.201879 (+ 49us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:29.201936 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:29.202061 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 02:32:29.202092 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:32:29.202171 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.199772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:45965 (local address 127.17.79.3:49985)
0811 02:32:29.199906 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:29.199917 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:29.199960 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:29.200098 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:29.200099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:29.200101 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:29.200143 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.200144 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.200692 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.200693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.201236 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:29.201238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.201674 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.201676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:29.201734 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.201738 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:29.201993 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:29.201995 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:29.202055 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 02:32:29.202102 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":84,"threads_started":1}
I20260811 02:32:29.209188 20971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:29.209331 20971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:29.210002 20971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Sending DeleteTablet for 3 replicas of tablet 1a826a6200f64fa8a9ae75fffe0e3d19
I20260811 02:32:29.210317 21502 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a826a6200f64fa8a9ae75fffe0e3d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:29 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:60508
I20260811 02:32:29.210421 21245 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a826a6200f64fa8a9ae75fffe0e3d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:29 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:49286
I20260811 02:32:29.210517 22055 tablet_replica.cc:330] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: stopping tablet replica
I20260811 02:32:29.210518 22054 tablet_replica.cc:330] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: stopping tablet replica
I20260811 02:32:29.210580 22054 raft_consensus.cc:2229] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:29.210595 22055 raft_consensus.cc:2229] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:29.210647 22055 raft_consensus.cc:2258] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:29.210672 22054 raft_consensus.cc:2258] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:29.210813 21750 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a826a6200f64fa8a9ae75fffe0e3d19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:29 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:38128
I20260811 02:32:29.210827 20971 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 02:32:29.210917 22056 tablet_replica.cc:330] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: stopping tablet replica
W20260811 02:32:29.210963 20971 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:29.210971 22056 raft_consensus.cc:2229] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:29.211009 22056 raft_consensus.cc:2258] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:29.210990 22054 ts_tablet_manager.cc:1905] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:29.211069 22055 ts_tablet_manager.cc:1905] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:29.211331 22056 ts_tablet_manager.cc:1905] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:29.212044 21245 tablet_service.cc:1467] Processing CreateTablet for tablet 6189947fe25d4b7983f063022c28350b (DEFAULT_TABLE table=test-table [id=175742bed3984233806a9bbe7a7f0e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:29.212167 21245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6189947fe25d4b7983f063022c28350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:29.212541 22055 ts_tablet_manager.cc:1918] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:29.212541 22054 ts_tablet_manager.cc:1918] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:29.212604 22054 log.cc:1196] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/1a826a6200f64fa8a9ae75fffe0e3d19
I20260811 02:32:29.212612 22055 log.cc:1196] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/1a826a6200f64fa8a9ae75fffe0e3d19
I20260811 02:32:29.212836 22055 ts_tablet_manager.cc:1939] T 1a826a6200f64fa8a9ae75fffe0e3d19 P 667238ce1ca24e9f9477d57cf2ce2104: Deleting consensus metadata
I20260811 02:32:29.212836 22054 ts_tablet_manager.cc:1939] T 1a826a6200f64fa8a9ae75fffe0e3d19 P bdf9f198db3143cbb02f7c1b7d76c203: Deleting consensus metadata
I20260811 02:32:29.212955 22056 ts_tablet_manager.cc:1918] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:29.213011 22056 log.cc:1196] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/1a826a6200f64fa8a9ae75fffe0e3d19
I20260811 02:32:29.213231 22056 ts_tablet_manager.cc:1939] T 1a826a6200f64fa8a9ae75fffe0e3d19 P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting consensus metadata
I20260811 02:32:29.213521 22071 tablet_bootstrap.cc:492] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203: Bootstrap starting.
I20260811 02:32:29.213941 22071 tablet_bootstrap.cc:654] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:29.214373 20940 catalog_manager.cc:4841] TS bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965): tablet 1a826a6200f64fa8a9ae75fffe0e3d19 (table test-table [id=546c771027154fc79b3e154105912d9a]) successfully deleted
I20260811 02:32:29.214448 20943 catalog_manager.cc:4841] TS 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243): tablet 1a826a6200f64fa8a9ae75fffe0e3d19 (table test-table [id=546c771027154fc79b3e154105912d9a]) successfully deleted
I20260811 02:32:29.214625 22071 tablet_bootstrap.cc:492] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203: No bootstrap required, opened a new log
I20260811 02:32:29.214639 20944 catalog_manager.cc:4841] TS ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501): tablet 1a826a6200f64fa8a9ae75fffe0e3d19 (table test-table [id=546c771027154fc79b3e154105912d9a]) successfully deleted
I20260811 02:32:29.214687 22071 ts_tablet_manager.cc:1397] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:29.214722 21750 tablet_service.cc:1467] Processing CreateTablet for tablet 6189947fe25d4b7983f063022c28350b (DEFAULT_TABLE table=test-table [id=175742bed3984233806a9bbe7a7f0e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:29.214823 21750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6189947fe25d4b7983f063022c28350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:29.214843 22071 raft_consensus.cc:348] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.214903 22071 raft_consensus.cc:374] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:29.214928 22071 raft_consensus.cc:729] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf9f198db3143cbb02f7c1b7d76c203, State: Initialized, Role: FOLLOWER
I20260811 02:32:29.214912 21502 tablet_service.cc:1467] Processing CreateTablet for tablet 6189947fe25d4b7983f063022c28350b (DEFAULT_TABLE table=test-table [id=175742bed3984233806a9bbe7a7f0e1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:29.214980 22071 consensus_queue.cc:260] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.215015 21502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6189947fe25d4b7983f063022c28350b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:29.215085 22071 ts_tablet_manager.cc:1428] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:29.216132 22075 tablet_bootstrap.cc:492] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: Bootstrap starting.
I20260811 02:32:29.216135 22070 tablet_bootstrap.cc:492] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: Bootstrap starting.
I20260811 02:32:29.216418 22075 tablet_bootstrap.cc:654] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:29.216457 22070 tablet_bootstrap.cc:654] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:29.216975 22070 tablet_bootstrap.cc:492] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: No bootstrap required, opened a new log
I20260811 02:32:29.217042 22070 ts_tablet_manager.cc:1397] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:29.217170 22070 raft_consensus.cc:348] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.217240 22070 raft_consensus.cc:374] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:29.217271 22070 raft_consensus.cc:729] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667238ce1ca24e9f9477d57cf2ce2104, State: Initialized, Role: FOLLOWER
I20260811 02:32:29.217322 22070 consensus_queue.cc:260] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.217429 22070 ts_tablet_manager.cc:1428] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:29.224985 22075 tablet_bootstrap.cc:492] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: No bootstrap required, opened a new log
I20260811 02:32:29.225090 22075 ts_tablet_manager.cc:1397] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260811 02:32:29.225224 22075 raft_consensus.cc:348] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.225332 22075 raft_consensus.cc:374] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:29.225370 22075 raft_consensus.cc:729] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Initialized, Role: FOLLOWER
I20260811 02:32:29.225435 22075 consensus_queue.cc:260] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.225538 22075 ts_tablet_manager.cc:1428] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:29.498520 21954 raft_consensus.cc:482] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:29.498638 21954 raft_consensus.cc:504] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.498865 21954 leader_election.cc:288] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243)
I20260811 02:32:29.499157 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6189947fe25d4b7983f063022c28350b" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104" is_pre_election: true
I20260811 02:32:29.499203 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6189947fe25d4b7983f063022c28350b" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" is_pre_election: true
I20260811 02:32:29.499282 21537 raft_consensus.cc:2454] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 0.
I20260811 02:32:29.499315 21280 raft_consensus.cc:2454] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 0.
I20260811 02:32:29.499457 21665 leader_election.cc:302] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 667238ce1ca24e9f9477d57cf2ce2104, ffe16dc60f3747539b08f9e7dfa0cb15; no voters:
I20260811 02:32:29.499574 21954 raft_consensus.cc:2781] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:29.499631 21954 raft_consensus.cc:482] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:29.499655 21954 raft_consensus.cc:3037] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:29.500357 21954 raft_consensus.cc:504] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.500488 21954 leader_election.cc:288] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 election: Requested vote from peers bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965), 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243)
I20260811 02:32:29.500649 21537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6189947fe25d4b7983f063022c28350b" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "667238ce1ca24e9f9477d57cf2ce2104"
I20260811 02:32:29.500653 21280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6189947fe25d4b7983f063022c28350b" candidate_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf9f198db3143cbb02f7c1b7d76c203"
I20260811 02:32:29.500725 21280 raft_consensus.cc:3037] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:29.500723 21537 raft_consensus.cc:3037] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:29.501474 21280 raft_consensus.cc:2454] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 1.
I20260811 02:32:29.501474 21537 raft_consensus.cc:2454] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffe16dc60f3747539b08f9e7dfa0cb15 in term 1.
I20260811 02:32:29.501683 21663 leader_election.cc:302] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf9f198db3143cbb02f7c1b7d76c203, ffe16dc60f3747539b08f9e7dfa0cb15; no voters:
I20260811 02:32:29.501819 21954 raft_consensus.cc:2781] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:29.501891 21954 raft_consensus.cc:686] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 LEADER]: Becoming Leader. State: Replica: ffe16dc60f3747539b08f9e7dfa0cb15, State: Running, Role: LEADER
I20260811 02:32:29.501948 21954 consensus_queue.cc:237] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } }
I20260811 02:32:29.502576 20971 catalog_manager.cc:5495] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3). New cstate: current_term: 1 leader_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe16dc60f3747539b08f9e7dfa0cb15" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39501 } health_report { overall_health: HEALTHY } } }
I20260811 02:32:29.575654 22086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:29.573413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38154 (local address 127.17.79.3:39501)
0811 02:32:29.573456 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:29.573459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:29.573467 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:32:29.573530 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:29.573531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:29.573543 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:29.573607 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:29.573729 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.574205 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.574956 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:29.575161 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:29.575239 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:29.575389 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:29.575428 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:29.575483 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:29.575543 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 02:32:29.575564 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:32:29.578099 21280 raft_consensus.cc:1261] T 6189947fe25d4b7983f063022c28350b P bdf9f198db3143cbb02f7c1b7d76c203 [term 1 FOLLOWER]: Refusing update from remote peer ffe16dc60f3747539b08f9e7dfa0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:29.578099 21537 raft_consensus.cc:1261] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Refusing update from remote peer ffe16dc60f3747539b08f9e7dfa0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:29.578326 22030 consensus_queue.cc:1035] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "667238ce1ca24e9f9477d57cf2ce2104" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:29.578449 22022 consensus_queue.cc:1035] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf9f198db3143cbb02f7c1b7d76c203" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 02:32:29.582828 22020 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 02:32:31.100960 20974 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:31.101063 20974 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:31.101989 20974 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e23eb82312644360b471dc862c469ecd: Sending DeleteTablet for 3 replicas of tablet 6189947fe25d4b7983f063022c28350b
I20260811 02:32:31.102267 21245 tablet_service.cc:1514] Processing DeleteTablet for tablet 6189947fe25d4b7983f063022c28350b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:31 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:49286
I20260811 02:32:31.102281 21502 tablet_service.cc:1514] Processing DeleteTablet for tablet 6189947fe25d4b7983f063022c28350b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:31 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:60508
I20260811 02:32:31.102312 21750 tablet_service.cc:1514] Processing DeleteTablet for tablet 6189947fe25d4b7983f063022c28350b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:31 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:38128
I20260811 02:32:31.102626 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21110
I20260811 02:32:31.114403 22161 tablet_replica.cc:330] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: stopping tablet replica
I20260811 02:32:31.114530 22161 raft_consensus.cc:2229] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:31.114610 22161 raft_consensus.cc:2258] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:31.114773 22168 tablet_replica.cc:330] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: stopping tablet replica
I20260811 02:32:31.114938 22161 ts_tablet_manager.cc:1905] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:31.115072 22168 raft_consensus.cc:2229] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:31.115175 22168 raft_consensus.cc:2258] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:31.115494 22168 ts_tablet_manager.cc:1905] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:31.116724 22161 ts_tablet_manager.cc:1918] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 02:32:31.116812 22161 log.cc:1196] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/6189947fe25d4b7983f063022c28350b
I20260811 02:32:31.117095 22161 ts_tablet_manager.cc:1939] T 6189947fe25d4b7983f063022c28350b P 667238ce1ca24e9f9477d57cf2ce2104: Deleting consensus metadata
I20260811 02:32:31.117512 20943 catalog_manager.cc:4841] TS 667238ce1ca24e9f9477d57cf2ce2104 (127.17.79.2:37243): tablet 6189947fe25d4b7983f063022c28350b (table test-table [id=175742bed3984233806a9bbe7a7f0e1a]) successfully deleted
I20260811 02:32:31.117808 22168 ts_tablet_manager.cc:1918] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 02:32:31.117880 22168 log.cc:1196] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/6189947fe25d4b7983f063022c28350b
I20260811 02:32:31.118101 22168 ts_tablet_manager.cc:1939] T 6189947fe25d4b7983f063022c28350b P ffe16dc60f3747539b08f9e7dfa0cb15: Deleting consensus metadata
I20260811 02:32:31.118535 20944 catalog_manager.cc:4841] TS ffe16dc60f3747539b08f9e7dfa0cb15 (127.17.79.3:39501): tablet 6189947fe25d4b7983f063022c28350b (table test-table [id=175742bed3984233806a9bbe7a7f0e1a]) successfully deleted
W20260811 02:32:31.121985 20940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:45965 (error 108)
I20260811 02:32:31.122324 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21384
I20260811 02:32:31.129928 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:31.128595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:45965 (local address 127.0.0.1:49312)
0811 02:32:31.129828 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:31.129887 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:45965: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1207,"thread_start_us":1185,"threads_started":1}
W20260811 02:32:31.130096 20940 catalog_manager.cc:4584] TS bdf9f198db3143cbb02f7c1b7d76c203 (127.17.79.1:45965): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6189947fe25d4b7983f063022c28350b: Network error: Client connection negotiation failed: client connection to 127.17.79.1:45965: connect: Connection refused (error 111)
I20260811 02:32:31.136847 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21642
I20260811 02:32:31.152052 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 20902
2026-08-11T02:32:31Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6558 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:31 dist-test-slave-7nm7 krb5kdc[22175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:31 dist-test-slave-7nm7 krb5kdc[22175](info): set up 2 sockets
Aug 11 02:32:31 dist-test-slave-7nm7 krb5kdc[22175](info): commencing operation
krb5kdc: starting...
W20260811 02:32:32.455873 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:32 dist-test-slave-7nm7 krb5kdc[22175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:32.576700 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:37129
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:37129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:32.659816 22197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:32.660089 22197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:32.660130 22197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:32.661285 22197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:32.661360 22197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:32.661386 22197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:32.661419 22197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:32.661445 22197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:32.663561 22197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:37129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:37129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:32.663864 22197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:32.664099 22197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:32.669385 22203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:32.669449 22197 server_base.cc:1034] running on GCE node
W20260811 02:32:32.669379 22202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:32.669378 22205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:32.669835 22197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:32.670156 22197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:32.671393 22197 hybrid_clock.cc:648] HybridClock initialized: now 1786415552671365 us; error 38 us; skew 500 ppm
Aug 11 02:32:32 dist-test-slave-7nm7 krb5kdc[22175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415552, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:32.674520 22197 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:32.675040 22197 webserver.cc:460] Webserver started at http://127.17.79.62:46401/ using document root <none> and password file <none>
I20260811 02:32:32.675289 22197 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:32.675362 22197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:32.675519 22197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:32.676600 22197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "1148c798bbac45e6ad0d69db11fb4365"
format_stamp: "Formatted at 2026-08-11 02:32:32 on dist-test-slave-7nm7"
server_key: "b0fa72899b050dad70c2d24c88b580a6"
server_key_iv: "2f60e96703cd2ee7a84cff0be2affe07"
server_key_version: "encryptionkey@0"
I20260811 02:32:32.676982 22197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "1148c798bbac45e6ad0d69db11fb4365"
format_stamp: "Formatted at 2026-08-11 02:32:32 on dist-test-slave-7nm7"
server_key: "b0fa72899b050dad70c2d24c88b580a6"
server_key_iv: "2f60e96703cd2ee7a84cff0be2affe07"
server_key_version: "encryptionkey@0"
I20260811 02:32:32.678434 22197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:32.679293 22219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:32.679549 22197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:32.679677 22197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "1148c798bbac45e6ad0d69db11fb4365"
format_stamp: "Formatted at 2026-08-11 02:32:32 on dist-test-slave-7nm7"
server_key: "b0fa72899b050dad70c2d24c88b580a6"
server_key_iv: "2f60e96703cd2ee7a84cff0be2affe07"
server_key_version: "encryptionkey@0"
I20260811 02:32:32.679759 22197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:32.697475 22197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:32.699620 22197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:32.699800 22197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:32.704800 22197 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:37129
I20260811 02:32:32.704849 22319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:37129 every 8 connection(s)
I20260811 02:32:32.705233 22197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:32.706166 22321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:32.708617 22321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365: Bootstrap starting.
I20260811 02:32:32.709182 22321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:32.709431 22321 log.cc:824] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:32.710093 22321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365: No bootstrap required, opened a new log
I20260811 02:32:32.711545 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22197
I20260811 02:32:32.711642 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:32.711833 17724 external_mini_cluster.cc:1428] Setting key 9ad058a3b12f27875ae8f866a29faa8c
I20260811 02:32:32.712067 22321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1148c798bbac45e6ad0d69db11fb4365" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37129 } }
I20260811 02:32:32.712252 22321 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:32.712570 22321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1148c798bbac45e6ad0d69db11fb4365, State: Initialized, Role: FOLLOWER
I20260811 02:32:32.712735 22321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1148c798bbac45e6ad0d69db11fb4365" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37129 } }
I20260811 02:32:32.712838 22321 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:32.712889 22321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:32.712950 22321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:32.714140 22321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1148c798bbac45e6ad0d69db11fb4365" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37129 } }
I20260811 02:32:32.714285 22321 leader_election.cc:302] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1148c798bbac45e6ad0d69db11fb4365; no voters:
I20260811 02:32:32.714483 22321 leader_election.cc:288] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:32.714501 22332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:32.714612 22332 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [term 1 LEADER]: Becoming Leader. State: Replica: 1148c798bbac45e6ad0d69db11fb4365, State: Running, Role: LEADER
I20260811 02:32:32.714767 22332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1148c798bbac45e6ad0d69db11fb4365" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37129 } }
I20260811 02:32:32.714779 22321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:32.715402 22333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1148c798bbac45e6ad0d69db11fb4365. Latest consensus state: current_term: 1 leader_uuid: "1148c798bbac45e6ad0d69db11fb4365" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1148c798bbac45e6ad0d69db11fb4365" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37129 } } }
I20260811 02:32:32.715428 22334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1148c798bbac45e6ad0d69db11fb4365" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1148c798bbac45e6ad0d69db11fb4365" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37129 } } }
I20260811 02:32:32.715509 22333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:32.715516 22334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365 [sys.catalog]: This master's current role is: LEADER
W20260811 02:32:32.716850 22358 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:32.716931 22358 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:32.717015 22344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:32.717195 22344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:32.719079 22344 catalog_manager.cc:1347] Generated new cluster ID: cc31baca40f645c086d31b793f70924e
I20260811 02:32:32.719139 22344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:32:32 dist-test-slave-7nm7 krb5kdc[22175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:32.724190 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:32.712376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53428 (local address 127.17.79.62:37129)
0811 02:32:32.712571 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:32.712581 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:32.712819 (+ 238us) server_negotiation.cc:407] Connection header received
0811 02:32:32.712988 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:32.712996 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:32.713068 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:32.713517 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:32.714462 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:32.716127 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:32.717355 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:32.717935 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:32.718072 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:32.720687 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:32.720691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:32.720691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:32.720704 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:32.722557 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:32.722973 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:32.722977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:32.722977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:32.723083 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:32.723318 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:32.723319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:32.723319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:32.723571 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:32.723766 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:32.723837 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 02:32:32.723981 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":114,"threads_started":1}
I20260811 02:32:32.737882 22344 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:32.738627 22344 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:32.746847 22344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1148c798bbac45e6ad0d69db11fb4365: Generated new TSK 0
I20260811 02:32:32.747038 22344 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:32.776401 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37129
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:32.858316 22366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:32.858510 22366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:32.858532 22366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:32.859666 22366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:32.859715 22366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:32.859741 22366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:32.861145 22366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:32.861372 22366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:32.861611 22366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:32.866638 22379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:32.866644 22387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:32.866958 22366 server_base.cc:1034] running on GCE node
W20260811 02:32:32.866636 22378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:32.867241 22366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:32.867488 22366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:32.868655 22366 hybrid_clock.cc:648] HybridClock initialized: now 1786415552868650 us; error 40 us; skew 500 ppm
Aug 11 02:32:32 dist-test-slave-7nm7 krb5kdc[22175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415552, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:32.871160 22366 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:32.871654 22366 webserver.cc:460] Webserver started at http://127.17.79.1:32993/ using document root <none> and password file <none>
I20260811 02:32:32.871886 22366 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:32.871964 22366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:32.872113 22366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:32.873188 22366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "31a541221eae443a937c174e0eb59d64"
format_stamp: "Formatted at 2026-08-11 02:32:32 on dist-test-slave-7nm7"
server_key: "fa6fd89a194e15b0bab741c8d87ef9ed"
server_key_iv: "6a8a4fec0110f51dc51e7f70ec2f3299"
server_key_version: "encryptionkey@0"
I20260811 02:32:32.873564 22366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "31a541221eae443a937c174e0eb59d64"
format_stamp: "Formatted at 2026-08-11 02:32:32 on dist-test-slave-7nm7"
server_key: "fa6fd89a194e15b0bab741c8d87ef9ed"
server_key_iv: "6a8a4fec0110f51dc51e7f70ec2f3299"
server_key_version: "encryptionkey@0"
I20260811 02:32:32.875449 22366 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 02:32:32.876245 22397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:32.876461 22366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:32.876576 22366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "31a541221eae443a937c174e0eb59d64"
format_stamp: "Formatted at 2026-08-11 02:32:32 on dist-test-slave-7nm7"
server_key: "fa6fd89a194e15b0bab741c8d87ef9ed"
server_key_iv: "6a8a4fec0110f51dc51e7f70ec2f3299"
server_key_version: "encryptionkey@0"
I20260811 02:32:32.876669 22366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:32.889367 22366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:32.891343 22366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:32.891506 22366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:32.891779 22366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:32.892189 22366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:32.892280 22366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:32.892349 22366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:32.892388 22366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:32.899426 22366 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:37801
I20260811 02:32:32.899494 22594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:37801 every 8 connection(s)
I20260811 02:32:32.899844 22366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:32.901968 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22366
I20260811 02:32:32.902159 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:32.902400 17724 external_mini_cluster.cc:1428] Setting key d045f2b033643f9a909d6be2f254d3c7
Aug 11 02:32:32 dist-test-slave-7nm7 krb5kdc[22175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415552, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:32.910637 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:32.900645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:40191 (local address 127.17.79.62:37129)
0811 02:32:32.900713 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:32.900715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:32.900901 (+ 186us) server_negotiation.cc:407] Connection header received
0811 02:32:32.901374 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:32.901375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:32.901389 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:32.901454 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:32.902558 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:32.903125 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:32.904124 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:32.904442 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:32.904520 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:32.907063 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:32.907075 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:32.907076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:32.907084 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:32.909041 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:32.909496 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:32.909498 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:32.909498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:32.909565 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:32.909862 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:32.909863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:32.909863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:32.910031 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:32.910110 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:32.910427 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 02:32:32.910532 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:32:32.910686 22598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:32.900603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37129 (local address 127.17.79.1:40191)
0811 02:32:32.900764 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:32.900807 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:32.901280 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:32.901531 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:32.901535 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:32.902126 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:32.902447 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:32.902453 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:32.903229 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:32.903230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:32.904028 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:32.904030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:32.904536 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:32.904537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:32.904697 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:32.905283 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:32.905295 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:32.906966 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:32.909163 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:32.909170 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:32.909172 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:32.909410 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:32.909655 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:32.909656 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:32.909656 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:32.909782 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:32.910102 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:32.910107 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:32.910275 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 02:32:32.910376 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 02:32:32.910506 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260811 02:32:32.911365 22595 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37129
I20260811 02:32:32.911480 22595 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:32.911705 22595 heartbeater.cc:511] Master 127.17.79.62:37129 requested a full tablet report, sending...
I20260811 02:32:32.912343 22253 ts_manager.cc:194] Registered new tserver with Master: 31a541221eae443a937c174e0eb59d64 (127.17.79.1:37801)
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
I20260811 02:32:32.913192 22253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:40191
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:32.936410 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37129
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:33.029996 22602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:33.030197 22602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:33.030221 22602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:33.031390 22602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:33.031430 22602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:33.031457 22602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:33.032900 22602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:33.033078 22602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:33.033247 22602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:33.038158 22611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:33.038224 22617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:33.038195 22608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:33.038373 22602 server_base.cc:1034] running on GCE node
I20260811 02:32:33.038586 22602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:33.038823 22602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:33.039996 22602 hybrid_clock.cc:648] HybridClock initialized: now 1786415553039986 us; error 43 us; skew 500 ppm
Aug 11 02:32:33 dist-test-slave-7nm7 krb5kdc[22175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415553, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:33.042485 22602 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:33.042958 22602 webserver.cc:460] Webserver started at http://127.17.79.2:45999/ using document root <none> and password file <none>
I20260811 02:32:33.043181 22602 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:33.043227 22602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:33.043380 22602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:33.044423 22602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "6f4d2a86f3524635a24bb38eaee5deed"
format_stamp: "Formatted at 2026-08-11 02:32:33 on dist-test-slave-7nm7"
server_key: "a41fef21dd7608b40c92fc9ea5eb6a8a"
server_key_iv: "d868281e872424b32e6307f40b0fd2e7"
server_key_version: "encryptionkey@0"
I20260811 02:32:33.044807 22602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "6f4d2a86f3524635a24bb38eaee5deed"
format_stamp: "Formatted at 2026-08-11 02:32:33 on dist-test-slave-7nm7"
server_key: "a41fef21dd7608b40c92fc9ea5eb6a8a"
server_key_iv: "d868281e872424b32e6307f40b0fd2e7"
server_key_version: "encryptionkey@0"
I20260811 02:32:33.046121 22602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:33.046867 22627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:33.047163 22602 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:33.047277 22602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "6f4d2a86f3524635a24bb38eaee5deed"
format_stamp: "Formatted at 2026-08-11 02:32:33 on dist-test-slave-7nm7"
server_key: "a41fef21dd7608b40c92fc9ea5eb6a8a"
server_key_iv: "d868281e872424b32e6307f40b0fd2e7"
server_key_version: "encryptionkey@0"
I20260811 02:32:33.047351 22602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:33.060882 22602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:33.062930 22602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:33.063093 22602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:33.063342 22602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:33.063658 22602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:33.063699 22602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:33.063723 22602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:33.063769 22602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:33.069940 22602 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:40149
I20260811 02:32:33.069994 22825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:40149 every 8 connection(s)
I20260811 02:32:33.070384 22602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:33.072587 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22602
I20260811 02:32:33.072860 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:33.073113 17724 external_mini_cluster.cc:1428] Setting key 8e35c50bf75c229e26b8d6b48fc140a0
Aug 11 02:32:33 dist-test-slave-7nm7 krb5kdc[22175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415553, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:33.081215 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:33.071148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:53307 (local address 127.17.79.62:37129)
0811 02:32:33.071233 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:33.071235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:33.071403 (+ 168us) server_negotiation.cc:407] Connection header received
0811 02:32:33.071907 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:33.071909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:33.071922 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:33.071986 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:33.073041 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.073625 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.075127 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.075314 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.075373 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:33.077920 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:33.077921 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:33.077922 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:33.077930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:33.079743 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:33.080179 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:33.080181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:33.080181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:33.080244 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:33.080497 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:33.080498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:33.080498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:33.080678 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:33.080759 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:33.081016 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 02:32:33.081109 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 02:32:33.081394 22830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:33.071097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37129 (local address 127.17.79.2:53307)
0811 02:32:33.071298 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:33.071335 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:33.071803 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:33.072036 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:33.072040 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:33.072629 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:33.072886 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:33.072891 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.073738 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.073739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:33.075038 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:33.075041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.075401 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.075403 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:33.075561 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:33.076180 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:33.076188 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:33.077794 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:33.079828 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:33.079835 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:33.079837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:33.080057 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:33.080314 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:33.080315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:33.080316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:33.080426 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:33.080749 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:33.080756 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:33.080884 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 02:32:33.080995 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 02:32:33.081150 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":103,"threads_started":1}
I20260811 02:32:33.081909 22827 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37129
I20260811 02:32:33.082023 22827 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:33.082270 22827 heartbeater.cc:511] Master 127.17.79.62:37129 requested a full tablet report, sending...
I20260811 02:32:33.082695 22253 ts_manager.cc:194] Registered new tserver with Master: 6f4d2a86f3524635a24bb38eaee5deed (127.17.79.2:40149)
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
I20260811 02:32:33.083204 22253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:53307
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:33.098991 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37129
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:33.181878 22835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:33.182086 22835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:33.182144 22835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:33.183404 22835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:33.183445 22835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:33.183472 22835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:33.184871 22835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:33.185051 22835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:33.185245 22835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:33.190358 22844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:33.190378 22848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:33.190411 22846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:33.190521 22835 server_base.cc:1034] running on GCE node
I20260811 02:32:33.190796 22835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:33.191040 22835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:33.192204 22835 hybrid_clock.cc:648] HybridClock initialized: now 1786415553192169 us; error 49 us; skew 500 ppm
Aug 11 02:32:33 dist-test-slave-7nm7 krb5kdc[22175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415553, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:33.194924 22835 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:33.195379 22835 webserver.cc:460] Webserver started at http://127.17.79.3:45059/ using document root <none> and password file <none>
I20260811 02:32:33.195608 22835 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:33.195676 22835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:33.195834 22835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:33.196878 22835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "95f848b83603400780f2eaff170113cc"
format_stamp: "Formatted at 2026-08-11 02:32:33 on dist-test-slave-7nm7"
server_key: "b9d86e389797fbede2f41c19bff09d67"
server_key_iv: "92fc420a809e73aa39b0dc7805eee1c7"
server_key_version: "encryptionkey@0"
I20260811 02:32:33.197242 22835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "95f848b83603400780f2eaff170113cc"
format_stamp: "Formatted at 2026-08-11 02:32:33 on dist-test-slave-7nm7"
server_key: "b9d86e389797fbede2f41c19bff09d67"
server_key_iv: "92fc420a809e73aa39b0dc7805eee1c7"
server_key_version: "encryptionkey@0"
I20260811 02:32:33.198635 22835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:33.199645 22866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:33.199815 22835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:33.199930 22835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "95f848b83603400780f2eaff170113cc"
format_stamp: "Formatted at 2026-08-11 02:32:33 on dist-test-slave-7nm7"
server_key: "b9d86e389797fbede2f41c19bff09d67"
server_key_iv: "92fc420a809e73aa39b0dc7805eee1c7"
server_key_version: "encryptionkey@0"
I20260811 02:32:33.200026 22835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:33.214558 22835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:33.217012 22835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:33.217186 22835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:33.217406 22835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:33.217713 22835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:33.217748 22835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:33.217769 22835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:33.217815 22835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:33.223431 22835 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39375
I20260811 02:32:33.223512 23059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39375 every 8 connection(s)
I20260811 02:32:33.223834 22835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:33.224134 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22835
I20260811 02:32:33.224236 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:33.224459 17724 external_mini_cluster.cc:1428] Setting key 93f24412bdbdd1c7c8de363395dab74d
Aug 11 02:32:33 dist-test-slave-7nm7 krb5kdc[22175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415553, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:33.232707 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:33.224597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:51809 (local address 127.17.79.62:37129)
0811 02:32:33.224650 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:33.224652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:33.224949 (+ 297us) server_negotiation.cc:407] Connection header received
0811 02:32:33.225510 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:33.225511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:33.225521 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:33.225566 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:33.226513 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.226986 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.227900 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.228073 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.228133 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:33.230095 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:33.230096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:33.230096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:33.230103 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:33.231547 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:33.231900 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:33.231900 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:33.231901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:33.231951 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:33.232181 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:33.232182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:33.232183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:33.232314 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:33.232381 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:33.232580 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 02:32:33.232643 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:33.232858 23066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:33.224645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37129 (local address 127.17.79.3:51809)
0811 02:32:33.224820 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:33.224861 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:33.225404 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:33.225618 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:33.225621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:33.226180 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:33.226432 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:33.226437 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.227062 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.227063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:33.227830 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:33.227831 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:33.228141 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:33.228142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:33.228238 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:33.228684 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:33.228692 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:33.230012 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:33.231618 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:33.231624 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:33.231626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:33.231833 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:33.232008 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:33.232009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:33.232009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:33.232099 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:33.232381 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:33.232386 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:33.232488 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 02:32:33.232566 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 02:32:33.232677 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":106,"threads_started":1}
I20260811 02:32:33.233441 23063 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37129
I20260811 02:32:33.233542 23063 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:33.233714 23063 heartbeater.cc:511] Master 127.17.79.62:37129 requested a full tablet report, sending...
I20260811 02:32:33.234144 22253 ts_manager.cc:194] Registered new tserver with Master: 95f848b83603400780f2eaff170113cc (127.17.79.3:39375)
I20260811 02:32:33.234686 22253 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:51809
I20260811 02:32:33.236188 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 02:32:33.248458 22327 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:33.247482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53436 (local address 127.17.79.62:37129)
0811 02:32:33.247546 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:33.247548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:33.247703 (+ 155us) server_negotiation.cc:407] Connection header received
0811 02:32:33.247753 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:33.247754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:33.247764 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:33.247828 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:33.248383 (+ 555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53436: BlockingRecv error: recv got EOF from 127.0.0.1:53436 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 02:32:33.249840 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22366
I20260811 02:32:33.268853 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22602
I20260811 02:32:33.280313 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22835
I20260811 02:32:33.291733 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22197
2026-08-11T02:32:33Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2140 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:33 dist-test-slave-7nm7 krb5kdc[23087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:33 dist-test-slave-7nm7 krb5kdc[23087](info): set up 2 sockets
Aug 11 02:32:33 dist-test-slave-7nm7 krb5kdc[23087](info): commencing operation
krb5kdc: starting...
W20260811 02:32:34.599889 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:34 dist-test-slave-7nm7 krb5kdc[23087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:34.724939 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39321
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:39321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:34.810597 23116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:34.810801 23116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:34.810823 23116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:34.811975 23116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:34.812017 23116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:34.812031 23116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:34.812044 23116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:34.812057 23116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:34.813556 23116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:39321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:34.813807 23116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:34.814044 23116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:34.819226 23126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:34.819242 23131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:34.819242 23127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:34.819527 23116 server_base.cc:1034] running on GCE node
I20260811 02:32:34.819808 23116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:34.820096 23116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:34.821237 23116 hybrid_clock.cc:648] HybridClock initialized: now 1786415554821215 us; error 39 us; skew 500 ppm
Aug 11 02:32:34 dist-test-slave-7nm7 krb5kdc[23087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415554, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:34.823679 23116 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:34.824141 23116 webserver.cc:460] Webserver started at http://127.17.79.62:38517/ using document root <none> and password file <none>
I20260811 02:32:34.824373 23116 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:34.824442 23116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:34.824595 23116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:34.825651 23116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "4be07199066b4c1f8988475d7e0e2615"
format_stamp: "Formatted at 2026-08-11 02:32:34 on dist-test-slave-7nm7"
server_key: "0ddc04d70de95b6395d12d2b5ce7dca9"
server_key_iv: "3325c0ce5ebe3a6773805fb452e267af"
server_key_version: "encryptionkey@0"
I20260811 02:32:34.826023 23116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "4be07199066b4c1f8988475d7e0e2615"
format_stamp: "Formatted at 2026-08-11 02:32:34 on dist-test-slave-7nm7"
server_key: "0ddc04d70de95b6395d12d2b5ce7dca9"
server_key_iv: "3325c0ce5ebe3a6773805fb452e267af"
server_key_version: "encryptionkey@0"
I20260811 02:32:34.827531 23116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:34.828455 23145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:34.828650 23116 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:34.828773 23116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "4be07199066b4c1f8988475d7e0e2615"
format_stamp: "Formatted at 2026-08-11 02:32:34 on dist-test-slave-7nm7"
server_key: "0ddc04d70de95b6395d12d2b5ce7dca9"
server_key_iv: "3325c0ce5ebe3a6773805fb452e267af"
server_key_version: "encryptionkey@0"
I20260811 02:32:34.828876 23116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:34.846611 23116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:34.848683 23116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:34.848887 23116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:34.853823 23116 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:39321
I20260811 02:32:34.853870 23232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:39321 every 8 connection(s)
I20260811 02:32:34.854526 23116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:34.855315 23233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:34.858012 23233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615: Bootstrap starting.
I20260811 02:32:34.858745 23233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:34.859122 23233 log.cc:824] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:34.859920 23233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615: No bootstrap required, opened a new log
I20260811 02:32:34.861351 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23116
I20260811 02:32:34.861450 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:34.861645 17724 external_mini_cluster.cc:1428] Setting key 27f62efd27c37149bffb070176cdf683
I20260811 02:32:34.861891 23233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be07199066b4c1f8988475d7e0e2615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39321 } }
I20260811 02:32:34.862067 23233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:34.862109 23233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be07199066b4c1f8988475d7e0e2615, State: Initialized, Role: FOLLOWER
I20260811 02:32:34.862257 23233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be07199066b4c1f8988475d7e0e2615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39321 } }
I20260811 02:32:34.862349 23233 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:34.862390 23233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:34.862435 23233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:34.863291 23233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be07199066b4c1f8988475d7e0e2615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39321 } }
I20260811 02:32:34.863412 23233 leader_election.cc:302] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4be07199066b4c1f8988475d7e0e2615; no voters:
I20260811 02:32:34.863590 23233 leader_election.cc:288] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:34.863744 23242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:34.863970 23233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:34.864033 23242 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [term 1 LEADER]: Becoming Leader. State: Replica: 4be07199066b4c1f8988475d7e0e2615, State: Running, Role: LEADER
I20260811 02:32:34.864167 23242 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be07199066b4c1f8988475d7e0e2615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39321 } }
I20260811 02:32:34.864530 23243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4be07199066b4c1f8988475d7e0e2615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be07199066b4c1f8988475d7e0e2615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39321 } } }
I20260811 02:32:34.864612 23243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:34.864820 23245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4be07199066b4c1f8988475d7e0e2615. Latest consensus state: current_term: 1 leader_uuid: "4be07199066b4c1f8988475d7e0e2615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be07199066b4c1f8988475d7e0e2615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39321 } } }
I20260811 02:32:34.864905 23245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:34.865026 23257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:34.865520 23257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 02:32:34 dist-test-slave-7nm7 krb5kdc[23087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:34.870880 23257 catalog_manager.cc:1347] Generated new cluster ID: 16092a62f85a4b75a8e2dd466713c180
I20260811 02:32:34.870940 23257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:34.874315 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:34.862192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55672 (local address 127.17.79.62:39321)
0811 02:32:34.863007 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:34.863016 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:34.863051 (+ 35us) server_negotiation.cc:407] Connection header received
0811 02:32:34.863191 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:34.863199 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:34.863266 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:34.863751 (+ 485us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:34.865037 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:34.866594 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:34.867652 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:34.868070 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:34.868161 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:34.870874 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:34.870877 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:34.870878 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:34.870890 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:34.872688 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:34.873082 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:34.873085 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:34.873086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:34.873197 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:34.873420 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:34.873421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:34.873421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:34.873661 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:34.873844 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:34.873912 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 02:32:34.874052 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":599,"threads_started":1}
I20260811 02:32:34.875278 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:32:34.889650 23257 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:34.890429 23257 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:34.894464 23257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4be07199066b4c1f8988475d7e0e2615: Generated new TSK 0
I20260811 02:32:34.894649 23257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:32:34.901515 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:34.897518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55686 (local address 127.17.79.62:39321)
0811 02:32:34.897596 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:34.897598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:34.897744 (+ 146us) server_negotiation.cc:407] Connection header received
0811 02:32:34.897814 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:34.897815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:34.897825 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:34.897888 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:34.898396 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:34.898896 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:34.899957 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:34.900173 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:34.900229 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:34.900944 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:34.900945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:34.900945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:34.901159 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:34.901175 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:34.901182 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:34.901231 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:34.901350 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 02:32:34.901375 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:32:34.904532 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23116
2026-08-11T02:32:34Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1613 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:34 dist-test-slave-7nm7 krb5kdc[23295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:34 dist-test-slave-7nm7 krb5kdc[23295](info): set up 2 sockets
Aug 11 02:32:34 dist-test-slave-7nm7 krb5kdc[23295](info): commencing operation
krb5kdc: starting...
W20260811 02:32:36.221057 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:36.349191 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:34761
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:34761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:36.436280 23323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:36.436537 23323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:36.436574 23323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:36.437737 23323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:36.437808 23323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:36.437834 23323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:36.437861 23323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:36.437913 23323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:36.440500 23323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:34761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:34761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:36.440806 23323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:36.441087 23323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:36.448176 23330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:36.448177 23331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:36.448462 23323 server_base.cc:1034] running on GCE node
W20260811 02:32:36.448405 23334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:36.448939 23323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:36.449275 23323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:36.450444 23323 hybrid_clock.cc:648] HybridClock initialized: now 1786415556450432 us; error 39 us; skew 500 ppm
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:36.458314 23323 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:36.458809 23323 webserver.cc:460] Webserver started at http://127.17.79.62:37699/ using document root <none> and password file <none>
I20260811 02:32:36.459003 23323 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:36.459043 23323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:36.459136 23323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:36.460192 23323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "482c7ab3e662472dbd6d823bca013cba"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "1cd4d95b2262c1a77c3bfa4ba139a991"
server_key_iv: "d81840df2ce3ff78e8e1c2dec3303491"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.460497 23323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "482c7ab3e662472dbd6d823bca013cba"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "1cd4d95b2262c1a77c3bfa4ba139a991"
server_key_iv: "d81840df2ce3ff78e8e1c2dec3303491"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.461792 23323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:36.462597 23347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:36.462878 23323 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:36.462966 23323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "482c7ab3e662472dbd6d823bca013cba"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "1cd4d95b2262c1a77c3bfa4ba139a991"
server_key_iv: "d81840df2ce3ff78e8e1c2dec3303491"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.463078 23323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:36.493775 23323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:36.496325 23323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:36.496495 23323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:36.501010 23323 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:34761
I20260811 02:32:36.501084 23439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:34761 every 8 connection(s)
I20260811 02:32:36.501420 23323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:36.502580 23440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:36.504957 23440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba: Bootstrap starting.
I20260811 02:32:36.505317 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23323
I20260811 02:32:36.505421 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:36.505599 17724 external_mini_cluster.cc:1428] Setting key 36fef3710848eb8d5611d0618b1383bb
I20260811 02:32:36.505849 23440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:36.506291 23440 log.cc:824] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:36.507102 23440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba: No bootstrap required, opened a new log
I20260811 02:32:36.509425 23440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "482c7ab3e662472dbd6d823bca013cba" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34761 } }
I20260811 02:32:36.509609 23440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:36.509637 23440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 482c7ab3e662472dbd6d823bca013cba, State: Initialized, Role: FOLLOWER
I20260811 02:32:36.509774 23440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "482c7ab3e662472dbd6d823bca013cba" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34761 } }
I20260811 02:32:36.509858 23440 raft_consensus.cc:388] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:36.509881 23440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:36.509948 23440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:36.510661 23440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "482c7ab3e662472dbd6d823bca013cba" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34761 } }
I20260811 02:32:36.510773 23440 leader_election.cc:302] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 482c7ab3e662472dbd6d823bca013cba; no voters:
I20260811 02:32:36.510934 23440 leader_election.cc:288] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:36.511031 23449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:36.511205 23440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:36.511221 23449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [term 1 LEADER]: Becoming Leader. State: Replica: 482c7ab3e662472dbd6d823bca013cba, State: Running, Role: LEADER
I20260811 02:32:36.511364 23449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "482c7ab3e662472dbd6d823bca013cba" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34761 } }
I20260811 02:32:36.511853 23449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 482c7ab3e662472dbd6d823bca013cba. Latest consensus state: current_term: 1 leader_uuid: "482c7ab3e662472dbd6d823bca013cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "482c7ab3e662472dbd6d823bca013cba" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34761 } } }
I20260811 02:32:36.511972 23449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:36.511866 23453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "482c7ab3e662472dbd6d823bca013cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "482c7ab3e662472dbd6d823bca013cba" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 34761 } } }
I20260811 02:32:36.512216 23453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:36.512629 23459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:36.513173 23459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:36.514778 23459 catalog_manager.cc:1347] Generated new cluster ID: bf58b819ebe24b1aaff288489d2212d2
I20260811 02:32:36.514832 23459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:36.521469 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:36.506196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42560 (local address 127.17.79.62:34761)
0811 02:32:36.506460 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:36.506470 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:36.506507 (+ 37us) server_negotiation.cc:407] Connection header received
0811 02:32:36.507118 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:36.507128 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:36.507188 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:36.507346 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:36.507976 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.509397 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.510443 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.511100 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.511207 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:36.514320 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:36.514324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:36.514324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:36.514337 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:36.519803 (+ 5466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:36.520261 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:36.520264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:36.520265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:36.520366 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:36.520588 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:36.520589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:36.520589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:36.520878 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:36.521010 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:36.521140 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 02:32:36.521269 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":140,"threads_started":1}
I20260811 02:32:36.525211 23459 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:36.525900 23459 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:36.534426 23459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 482c7ab3e662472dbd6d823bca013cba: Generated new TSK 0
I20260811 02:32:36.534626 23459 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:36.563270 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34761
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:36.646787 23480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:36.647015 23480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:36.647053 23480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:36.648200 23480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:36.648268 23480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:36.648313 23480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:36.649762 23480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:36.649945 23480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:36.650113 23480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:32:36.655426 23480 server_base.cc:1034] running on GCE node
W20260811 02:32:36.655441 23485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:36.655423 23486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:36.655606 23488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:36.655933 23480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:36.656155 23480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:36.657337 23480 hybrid_clock.cc:648] HybridClock initialized: now 1786415556657332 us; error 53 us; skew 500 ppm
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:36.660161 23480 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:36.660627 23480 webserver.cc:460] Webserver started at http://127.17.79.1:37077/ using document root <none> and password file <none>
I20260811 02:32:36.660861 23480 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:36.660912 23480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:36.661053 23480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:36.662165 23480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "25417d6db6654068bf2b415cc4e1783c"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "2ba75d9fce6b38c8410f6bd956380752"
server_key_iv: "e69d40b26d5cacc588baab6d2f6ef907"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.662626 23480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "25417d6db6654068bf2b415cc4e1783c"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "2ba75d9fce6b38c8410f6bd956380752"
server_key_iv: "e69d40b26d5cacc588baab6d2f6ef907"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.664072 23480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:32:36.664907 23499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:36.665107 23480 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:36.665225 23480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "25417d6db6654068bf2b415cc4e1783c"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "2ba75d9fce6b38c8410f6bd956380752"
server_key_iv: "e69d40b26d5cacc588baab6d2f6ef907"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.665305 23480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:36.705170 23480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:36.707374 23480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:36.707556 23480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:36.707826 23480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:36.708158 23480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:36.708217 23480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:36.708263 23480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:36.708288 23480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:36.714949 23480 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:38963
I20260811 02:32:36.715021 23698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:38963 every 8 connection(s)
I20260811 02:32:36.715375 23480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:36.719544 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23480
I20260811 02:32:36.719650 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:36.719851 17724 external_mini_cluster.cc:1428] Setting key 018d77b5e44112e26b2541f37c122d78
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:36.725076 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:36.716195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:45263 (local address 127.17.79.62:34761)
0811 02:32:36.716239 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:36.716241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:36.716470 (+ 229us) server_negotiation.cc:407] Connection header received
0811 02:32:36.716945 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:36.716946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:36.716955 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:36.717014 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:36.717968 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.718538 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.719515 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.719852 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.719936 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:36.722086 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:36.722088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:36.722089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:36.722096 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:36.723555 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:36.724067 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:36.724069 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:36.724069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:36.724126 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:36.724435 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:36.724436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:36.724436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:36.724543 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:36.724601 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:36.724938 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 02:32:36.725010 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:32:36.725420 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:36.716147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:34761 (local address 127.17.79.1:45263)
0811 02:32:36.716333 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:36.716377 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:36.716864 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:36.717068 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:36.717071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:36.717649 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:36.717847 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:36.717851 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.718627 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.718627 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:36.719418 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:36.719420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.719950 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.719951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:36.720061 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:36.720628 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:36.720637 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:36.721974 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:36.723662 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:36.723670 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:36.723673 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:36.723982 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:36.724207 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:36.724208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:36.724208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:36.724354 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:36.724612 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:36.724619 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:36.724802 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 02:32:36.724918 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 02:32:36.725122 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":110,"threads_started":1}
I20260811 02:32:36.726011 23699 heartbeater.cc:347] Connected to a master server at 127.17.79.62:34761
I20260811 02:32:36.726106 23699 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:36.726347 23699 heartbeater.cc:511] Master 127.17.79.62:34761 requested a full tablet report, sending...
I20260811 02:32:36.726897 23374 ts_manager.cc:194] Registered new tserver with Master: 25417d6db6654068bf2b415cc4e1783c (127.17.79.1:38963)
I20260811 02:32:36.727504 23374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:45263
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:36.746977 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34761
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:36.828999 23704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:36.829198 23704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:36.829221 23704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:36.830358 23704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:36.830399 23704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:36.830425 23704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:36.831845 23704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:36.832051 23704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:36.832218 23704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:36.837296 23712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:36.837306 23718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:36.837383 23704 server_base.cc:1034] running on GCE node
W20260811 02:32:36.837533 23715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:36.837805 23704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:36.838022 23704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:36.839157 23704 hybrid_clock.cc:648] HybridClock initialized: now 1786415556839159 us; error 48 us; skew 500 ppm
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:36.841559 23704 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:36.841984 23704 webserver.cc:460] Webserver started at http://127.17.79.2:43039/ using document root <none> and password file <none>
I20260811 02:32:36.842267 23704 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:36.842345 23704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:36.842481 23704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:36.843535 23704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "c048ec00ee92488b9bca881afaabbd38"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "dda5e378a23f55599950edfc9c623fb5"
server_key_iv: "8caf6473e6916921e94339af1d06ae05"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.843894 23704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "c048ec00ee92488b9bca881afaabbd38"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "dda5e378a23f55599950edfc9c623fb5"
server_key_iv: "8caf6473e6916921e94339af1d06ae05"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.845278 23704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:36.846035 23729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:36.846278 23704 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:36.846386 23704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "c048ec00ee92488b9bca881afaabbd38"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "dda5e378a23f55599950edfc9c623fb5"
server_key_iv: "8caf6473e6916921e94339af1d06ae05"
server_key_version: "encryptionkey@0"
I20260811 02:32:36.846470 23704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:36.865845 23704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:36.867802 23704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:36.867957 23704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:36.868227 23704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:36.868567 23704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:36.868610 23704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:36.868633 23704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:36.868688 23704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:36.874574 23704 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:44679
I20260811 02:32:36.874652 23927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:44679 every 8 connection(s)
I20260811 02:32:36.874971 23704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:36.882694 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23704
I20260811 02:32:36.882784 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:36.883013 17724 external_mini_cluster.cc:1428] Setting key f78fc95288157f73b37ac7d6b648159f
I20260811 02:32:36.884092 23935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:36.875618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:34761 (local address 127.17.79.2:33323)
0811 02:32:36.875803 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:36.875837 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:36.876306 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:36.876504 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:36.876507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:36.877053 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:36.877247 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:36.877252 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.877888 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.877889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:36.878748 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:36.878751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.879077 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.879078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:36.879191 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:36.879601 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:36.879608 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:36.880916 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:36.882604 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:36.882610 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:36.882611 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:36.882889 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:36.883098 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:36.883099 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:36.883099 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:36.883255 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:36.883551 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:36.883558 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:36.883717 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 02:32:36.883825 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 02:32:36.883942 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260811 02:32:36.884091 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:36.875680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:33323 (local address 127.17.79.62:34761)
0811 02:32:36.875764 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:36.875766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:36.875921 (+ 155us) server_negotiation.cc:407] Connection header received
0811 02:32:36.876389 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:36.876390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:36.876400 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:36.876448 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:36.877327 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.877812 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.878824 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:36.879001 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:36.879054 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:36.881024 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:36.881025 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:36.881026 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:36.881033 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:36.882525 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:36.882957 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:36.882958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:36.882959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:36.883021 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:36.883380 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:36.883381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:36.883381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:36.883485 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:36.883539 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:36.883875 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 02:32:36.883963 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 02:32:36.884639 23928 heartbeater.cc:347] Connected to a master server at 127.17.79.62:34761
I20260811 02:32:36.884853 23928 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:36.885046 23928 heartbeater.cc:511] Master 127.17.79.62:34761 requested a full tablet report, sending...
I20260811 02:32:36.885489 23374 ts_manager.cc:194] Registered new tserver with Master: c048ec00ee92488b9bca881afaabbd38 (127.17.79.2:44679)
I20260811 02:32:36.885891 23374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:33323
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:36.909372 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34761
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:36.991088 23941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:36.991333 23941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:36.991372 23941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:36.992522 23941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:36.992591 23941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:36.992638 23941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:36.994102 23941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:36.994388 23941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:36.994622 23941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:36.999768 23949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:36.999758 23954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:36.999758 23950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:36.999784 23941 server_base.cc:1034] running on GCE node
I20260811 02:32:37.000239 23941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:37.000489 23941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:37.001657 23941 hybrid_clock.cc:648] HybridClock initialized: now 1786415557001636 us; error 30 us; skew 500 ppm
Aug 11 02:32:36 dist-test-slave-7nm7 krb5kdc[23295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:37.004335 23941 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:37.004808 23941 webserver.cc:460] Webserver started at http://127.17.79.3:40435/ using document root <none> and password file <none>
I20260811 02:32:37.005044 23941 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:37.005111 23941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:37.005266 23941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:37.006371 23941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "6da565e09f3b49888738543a65577cb9"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "fec08e127b99bc30c6bba07b88be39e4"
server_key_iv: "d37058f362e8c515e74b600edff7f5d4"
server_key_version: "encryptionkey@0"
I20260811 02:32:37.006728 23941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "6da565e09f3b49888738543a65577cb9"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "fec08e127b99bc30c6bba07b88be39e4"
server_key_iv: "d37058f362e8c515e74b600edff7f5d4"
server_key_version: "encryptionkey@0"
I20260811 02:32:37.008091 23941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:37.008846 23970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:37.009049 23941 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:37.009161 23941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "6da565e09f3b49888738543a65577cb9"
format_stamp: "Formatted at 2026-08-11 02:32:36 on dist-test-slave-7nm7"
server_key: "fec08e127b99bc30c6bba07b88be39e4"
server_key_iv: "d37058f362e8c515e74b600edff7f5d4"
server_key_version: "encryptionkey@0"
I20260811 02:32:37.009236 23941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:37.036980 23941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:37.039742 23941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:37.039923 23941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:37.040192 23941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:37.040544 23941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:37.040599 23941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:37.040647 23941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:37.040679 23941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:37.047684 23941 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:45523
I20260811 02:32:37.047736 24153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:45523 every 8 connection(s)
I20260811 02:32:37.048141 23941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
Aug 11 02:32:37 dist-test-slave-7nm7 krb5kdc[23295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415556, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:37.055207 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23941
I20260811 02:32:37.055325 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:37.055538 17724 external_mini_cluster.cc:1428] Setting key d4eaa43851b3961aec918a51a29413ce
I20260811 02:32:37.059352 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:37.049003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:45467 (local address 127.17.79.62:34761)
0811 02:32:37.049061 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:37.049064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:37.049361 (+ 297us) server_negotiation.cc:407] Connection header received
0811 02:32:37.049819 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:37.049820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:37.049830 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:37.049896 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:37.051063 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:37.051586 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:37.052647 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:37.052847 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:37.052908 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:37.055296 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:37.055298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:37.055299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:37.055309 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:37.057658 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:37.058128 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:37.058130 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:37.058130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:37.058196 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:37.058502 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:37.058503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:37.058503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:37.058642 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:37.058717 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:37.059156 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 02:32:37.059244 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:32:37.059576 24156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:37.048966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:34761 (local address 127.17.79.3:45467)
0811 02:32:37.049213 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:37.049251 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:37.049734 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:37.049950 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:37.049954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:37.050751 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:37.050954 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:37.050959 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:37.051692 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:37.051693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:37.052557 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:37.052559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:37.052927 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:37.052928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:37.053029 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:37.053639 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:37.053651 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:37.055187 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:37.057764 (+ 2577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:37.057773 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:37.057775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:37.058025 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:37.058299 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:37.058300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:37.058301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:37.058423 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:37.058721 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:37.058728 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:37.058875 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 02:32:37.059126 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 02:32:37.059316 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":112,"threads_started":1}
I20260811 02:32:37.060089 24154 heartbeater.cc:347] Connected to a master server at 127.17.79.62:34761
I20260811 02:32:37.060171 24154 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:37.060369 24154 heartbeater.cc:511] Master 127.17.79.62:34761 requested a full tablet report, sending...
I20260811 02:32:37.060871 23374 ts_manager.cc:194] Registered new tserver with Master: 6da565e09f3b49888738543a65577cb9 (127.17.79.3:45523)
I20260811 02:32:37.061303 23374 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:45467
I20260811 02:32:37.068444 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 02:32:37 dist-test-slave-7nm7 krb5kdc[23295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415557, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 02:32:37 dist-test-slave-7nm7 krb5kdc[23295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415557, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:37.093272 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:37.085389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42564 (local address 127.17.79.62:34761)
0811 02:32:37.085474 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:37.085476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:37.085586 (+ 110us) server_negotiation.cc:407] Connection header received
0811 02:32:37.085632 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:37.085633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:37.085644 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:37.085710 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:37.086352 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:37.086855 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:37.087613 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:37.087799 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:37.087864 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:37.090223 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:37.090225 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:37.090225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:37.090351 (+ 126us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:37.091792 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:37.092269 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:37.092270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:37.092271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:37.092359 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:37.092586 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:37.092602 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:37.092602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:37.092852 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:37.092969 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:37.093084 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 02:32:37.093167 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 02:32:37.093510 23374 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42564
I20260811 02:32:37.094082 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23480
I20260811 02:32:37.117287 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23704
I20260811 02:32:37.125761 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23941
I20260811 02:32:37.137756 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23323
2026-08-11T02:32:37Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2231 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:37 dist-test-slave-7nm7 krb5kdc[24171](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:37 dist-test-slave-7nm7 krb5kdc[24171](info): set up 2 sockets
Aug 11 02:32:37 dist-test-slave-7nm7 krb5kdc[24171](info): commencing operation
krb5kdc: starting...
W20260811 02:32:38.429976 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:38 dist-test-slave-7nm7 krb5kdc[24171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:38.554905 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35693
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:35693
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:38.634402 24191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:38.634649 24191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:38.634688 24191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:38.635818 24191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:38.635890 24191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:38.635915 24191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:38.635948 24191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:38.635978 24191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:38.637462 24191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:35693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:38.637737 24191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:38.637974 24191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:38.642977 24200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:38.642987 24203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:38.643059 24201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:38.643400 24191 server_base.cc:1034] running on GCE node
I20260811 02:32:38.643680 24191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:38.644001 24191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:38.645171 24191 hybrid_clock.cc:648] HybridClock initialized: now 1786415558645153 us; error 49 us; skew 500 ppm
Aug 11 02:32:38 dist-test-slave-7nm7 krb5kdc[24171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415558, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:38.647773 24191 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:38.648262 24191 webserver.cc:460] Webserver started at http://127.17.79.62:41121/ using document root <none> and password file <none>
I20260811 02:32:38.648519 24191 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:38.648589 24191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:38.648743 24191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:38.649794 24191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "beaafc79fc214d1ab4fad84feac9c567"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "cc57347b6f4f66443bdfe194607d894c"
server_key_iv: "65fb36de3ca2f2ad70c46f8e15259355"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.650156 24191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "beaafc79fc214d1ab4fad84feac9c567"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "cc57347b6f4f66443bdfe194607d894c"
server_key_iv: "65fb36de3ca2f2ad70c46f8e15259355"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.651533 24191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:38.652240 24215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:38.652400 24191 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:38.652510 24191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "beaafc79fc214d1ab4fad84feac9c567"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "cc57347b6f4f66443bdfe194607d894c"
server_key_iv: "65fb36de3ca2f2ad70c46f8e15259355"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.652587 24191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:38.664008 24191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:38.665953 24191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:38.666122 24191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:38.670475 24191 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:35693
I20260811 02:32:38.670514 24304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:35693 every 8 connection(s)
I20260811 02:32:38.671011 24191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:38.671728 24306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:38.673930 24306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567: Bootstrap starting.
I20260811 02:32:38.674587 24306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:38.674827 24306 log.cc:824] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:38.675509 24306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567: No bootstrap required, opened a new log
I20260811 02:32:38.677066 24306 raft_consensus.cc:348] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaafc79fc214d1ab4fad84feac9c567" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35693 } }
I20260811 02:32:38.677202 24306 raft_consensus.cc:374] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:38.677225 24306 raft_consensus.cc:729] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: beaafc79fc214d1ab4fad84feac9c567, State: Initialized, Role: FOLLOWER
I20260811 02:32:38.677359 24306 consensus_queue.cc:260] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaafc79fc214d1ab4fad84feac9c567" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35693 } }
I20260811 02:32:38.677443 24306 raft_consensus.cc:388] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:38.677465 24306 raft_consensus.cc:482] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:38.677516 24306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:38.678452 24306 raft_consensus.cc:504] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaafc79fc214d1ab4fad84feac9c567" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35693 } }
I20260811 02:32:38.678541 24306 leader_election.cc:302] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: beaafc79fc214d1ab4fad84feac9c567; no voters:
I20260811 02:32:38.678664 24306 leader_election.cc:288] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:38.678782 24311 raft_consensus.cc:2781] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:38.678915 24306 sys_catalog.cc:564] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:38.678953 24311 raft_consensus.cc:686] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [term 1 LEADER]: Becoming Leader. State: Replica: beaafc79fc214d1ab4fad84feac9c567, State: Running, Role: LEADER
I20260811 02:32:38.679173 24311 consensus_queue.cc:237] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaafc79fc214d1ab4fad84feac9c567" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35693 } }
I20260811 02:32:38.679590 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24191
I20260811 02:32:38.679567 24315 sys_catalog.cc:455] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "beaafc79fc214d1ab4fad84feac9c567" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaafc79fc214d1ab4fad84feac9c567" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35693 } } }
I20260811 02:32:38.679646 24315 sys_catalog.cc:458] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:38.679718 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:38.679919 17724 external_mini_cluster.cc:1428] Setting key e67d1e5145654c6e11f5cbbe4a57a366
I20260811 02:32:38.680727 24316 sys_catalog.cc:455] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [sys.catalog]: SysCatalogTable state changed. Reason: New leader beaafc79fc214d1ab4fad84feac9c567. Latest consensus state: current_term: 1 leader_uuid: "beaafc79fc214d1ab4fad84feac9c567" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "beaafc79fc214d1ab4fad84feac9c567" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35693 } } }
I20260811 02:32:38.680876 24316 sys_catalog.cc:458] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567 [sys.catalog]: This master's current role is: LEADER
W20260811 02:32:38.681291 24346 catalog_manager.cc:1558] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:38.681348 24346 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:38.681969 24328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:38.682166 24328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:38.683769 24328 catalog_manager.cc:1347] Generated new cluster ID: 3033350778324ca59f4dbf99b6529584
I20260811 02:32:38.683825 24328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:32:38 dist-test-slave-7nm7 krb5kdc[24171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:38.688558 24328 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:38.689219 24328 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:38.690774 24350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:38.680676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47732 (local address 127.17.79.62:35693)
0811 02:32:38.680826 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:38.680835 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:38.680870 (+ 35us) server_negotiation.cc:407] Connection header received
0811 02:32:38.680985 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:38.680992 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:38.681054 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:38.681205 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:38.681971 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:38.683170 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:38.684201 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:38.684621 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:38.684771 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:38.687118 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:38.687122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:38.687122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:38.687134 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:38.689226 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:38.689606 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:38.689609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:38.689609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:38.689704 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:38.689920 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:38.689921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:38.689921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:38.690131 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:38.690350 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:38.690422 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 02:32:38.690581 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":78,"threads_started":1}
I20260811 02:32:38.695194 24328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P beaafc79fc214d1ab4fad84feac9c567: Generated new TSK 0
I20260811 02:32:38.695379 24328 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:38.723289 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35693
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:38.821794 24355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:38.822042 24355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:38.822081 24355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:38.823285 24355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:38.823360 24355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:38.823408 24355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:38.825021 24355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:38.825301 24355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:38.825551 24355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:38.832111 24363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:38.832059 24362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:38.832058 24365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:38.832530 24355 server_base.cc:1034] running on GCE node
I20260811 02:32:38.832772 24355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:38.833047 24355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:38.834299 24355 hybrid_clock.cc:648] HybridClock initialized: now 1786415558834281 us; error 36 us; skew 500 ppm
Aug 11 02:32:38 dist-test-slave-7nm7 krb5kdc[24171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415558, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:38.837173 24355 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:38.837718 24355 webserver.cc:460] Webserver started at http://127.17.79.1:41231/ using document root <none> and password file <none>
I20260811 02:32:38.837993 24355 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:38.838039 24355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:38.838487 24355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:38.839994 24355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "aa02a4b939954fbc9249911c645cde14"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "fd8c99e3070600e1e0a7f8c23af7cba8"
server_key_iv: "857fb231a76701774d19b3a09ba13f82"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.840371 24355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "aa02a4b939954fbc9249911c645cde14"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "fd8c99e3070600e1e0a7f8c23af7cba8"
server_key_iv: "857fb231a76701774d19b3a09ba13f82"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.841795 24355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:38.842685 24379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:38.842855 24355 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:38.842953 24355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "aa02a4b939954fbc9249911c645cde14"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "fd8c99e3070600e1e0a7f8c23af7cba8"
server_key_iv: "857fb231a76701774d19b3a09ba13f82"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.843009 24355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:38.858736 24355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:38.861140 24355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:38.861260 24355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:38.861460 24355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:38.861801 24355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:38.861836 24355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:38.861860 24355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:38.861907 24355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:38.868046 24355 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:39005
I20260811 02:32:38.868235 24576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:39005 every 8 connection(s)
I20260811 02:32:38.868482 24355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:38.869501 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24355
I20260811 02:32:38.869626 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:38.869813 17724 external_mini_cluster.cc:1428] Setting key d7a6b3c92d2c2acbca8dd2e810dde182
Aug 11 02:32:38 dist-test-slave-7nm7 krb5kdc[24171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415558, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
I20260811 02:32:38.880155 24350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:38.869257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:42729 (local address 127.17.79.62:35693)
0811 02:32:38.869348 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:38.869350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:38.869548 (+ 198us) server_negotiation.cc:407] Connection header received
0811 02:32:38.870786 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:38.870786 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:38.870800 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:38.870872 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:38.871607 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:38.872389 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:38.873888 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:38.874223 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:38.874328 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:38.876804 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:38.876806 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:38.876806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:38.876816 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:38.878564 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:38.878976 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:38.878977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:38.878978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:38.879043 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:38.879495 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:38.879496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:38.879496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:38.879648 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:38.879741 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:38.880015 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 02:32:38.880086 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 02:32:38.880388 24583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:38.869203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35693 (local address 127.17.79.1:42729)
0811 02:32:38.869419 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:38.869457 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:38.870675 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:38.870922 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:38.870925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:38.871301 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:38.871505 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:38.871510 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:38.872504 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:38.872505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:38.873791 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:38.873793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:38.874346 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:38.874347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:38.874452 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:38.875068 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:38.875080 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:38.876703 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:38.878649 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:38.878656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:38.878658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:38.878882 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:38.879132 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:38.879133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:38.879134 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:38.879361 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:38.879735 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:38.879741 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:38.879870 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 02:32:38.879959 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 02:32:38.880089 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":81,"threads_started":1}
I20260811 02:32:38.880930 24577 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35693
I20260811 02:32:38.881017 24577 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:38.881263 24577 heartbeater.cc:511] Master 127.17.79.62:35693 requested a full tablet report, sending...
I20260811 02:32:38.881984 24242 ts_manager.cc:194] Registered new tserver with Master: aa02a4b939954fbc9249911c645cde14 (127.17.79.1:39005)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
I20260811 02:32:38.882941 24242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:42729
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:38.898136 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35693
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:38.978899 24587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:38.979095 24587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:38.979120 24587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:38.980458 24587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:38.980510 24587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:38.980566 24587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:38.982074 24587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:38.982333 24587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:38.982580 24587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:38.987596 24597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:38.987567 24600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:38.987730 24587 server_base.cc:1034] running on GCE node
W20260811 02:32:38.987567 24603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:38.988157 24587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:38.988404 24587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:38.989583 24587 hybrid_clock.cc:648] HybridClock initialized: now 1786415558989568 us; error 28 us; skew 500 ppm
Aug 11 02:32:38 dist-test-slave-7nm7 krb5kdc[24171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415558, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:38.992122 24587 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:38.992586 24587 webserver.cc:460] Webserver started at http://127.17.79.2:38547/ using document root <none> and password file <none>
I20260811 02:32:38.992815 24587 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:38.992863 24587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:38.993016 24587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:38.994056 24587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "9233cc3df40f4532bd46fbbb7525d7e4"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "5d5fe627b1ff9ae60137d672a7142a3b"
server_key_iv: "4f588c7144b9dd1f010a918e2ecd3d41"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.994488 24587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "9233cc3df40f4532bd46fbbb7525d7e4"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "5d5fe627b1ff9ae60137d672a7142a3b"
server_key_iv: "4f588c7144b9dd1f010a918e2ecd3d41"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.995838 24587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:38.996634 24613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:38.996834 24587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:38.996924 24587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "9233cc3df40f4532bd46fbbb7525d7e4"
format_stamp: "Formatted at 2026-08-11 02:32:38 on dist-test-slave-7nm7"
server_key: "5d5fe627b1ff9ae60137d672a7142a3b"
server_key_iv: "4f588c7144b9dd1f010a918e2ecd3d41"
server_key_version: "encryptionkey@0"
I20260811 02:32:38.996973 24587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:39.028277 24587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:39.030716 24587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:39.030834 24587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:39.031031 24587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:39.031391 24587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:39.031427 24587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:39.031476 24587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:39.031504 24587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:39.037322 24587 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:43969
I20260811 02:32:39.037410 24801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:43969 every 8 connection(s)
I20260811 02:32:39.037729 24587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:39.043573 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24587
I20260811 02:32:39.043689 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:39.043892 17724 external_mini_cluster.cc:1428] Setting key 7775cc0d9bd5b0cc2b1dfc588d3e0011
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[24171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415558, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:39.047699 24350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:39.038522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:53329 (local address 127.17.79.62:35693)
0811 02:32:39.038567 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:39.038569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:39.038763 (+ 194us) server_negotiation.cc:407] Connection header received
0811 02:32:39.039741 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:39.039743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:39.039758 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:39.039808 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:39.040428 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.040925 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.041911 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.042117 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.042197 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:39.044589 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:39.044590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:39.044591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:39.044599 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:39.046140 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.046604 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.046605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.046606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.046668 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.047018 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.047019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.047020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.047140 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:39.047235 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:39.047516 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 02:32:39.047606 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:32:39.048050 24805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:39.038471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35693 (local address 127.17.79.2:53329)
0811 02:32:39.038635 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:39.038679 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:39.039620 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:39.039873 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:39.039877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:39.040140 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:39.040322 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:39.040327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.041021 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.041022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:39.041817 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:39.041819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.042206 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.042207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:39.042354 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:39.042816 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:39.042824 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:39.044483 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:39.046280 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:39.046287 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:39.046290 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:39.046522 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:39.046737 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:39.046737 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:39.046738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:39.046940 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:39.047229 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:39.047236 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:39.047378 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 02:32:39.047482 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 02:32:39.047642 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
I20260811 02:32:39.048795 24803 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35693
I20260811 02:32:39.048919 24803 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:39.049223 24803 heartbeater.cc:511] Master 127.17.79.62:35693 requested a full tablet report, sending...
I20260811 02:32:39.049677 24242 ts_manager.cc:194] Registered new tserver with Master: 9233cc3df40f4532bd46fbbb7525d7e4 (127.17.79.2:43969)
I20260811 02:32:39.050017 24242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:53329
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:39.071288 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35693
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:39.154474 24813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:39.154714 24813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:39.154738 24813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:39.155851 24813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:39.155886 24813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:39.155911 24813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:39.157398 24813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:39.157578 24813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:39.157743 24813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:39.163091 24825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:39.163204 24822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:39.163091 24823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:39.163309 24813 server_base.cc:1034] running on GCE node
I20260811 02:32:39.163535 24813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:39.163793 24813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:39.164983 24813 hybrid_clock.cc:648] HybridClock initialized: now 1786415559164959 us; error 40 us; skew 500 ppm
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[24171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415559, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:39.167817 24813 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:39.168304 24813 webserver.cc:460] Webserver started at http://127.17.79.3:34183/ using document root <none> and password file <none>
I20260811 02:32:39.168534 24813 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:39.168610 24813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:39.168745 24813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:39.169785 24813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "2096e73a149f4fbab1657e86651a6070"
format_stamp: "Formatted at 2026-08-11 02:32:39 on dist-test-slave-7nm7"
server_key: "76a35134b2a2c14778c49dfb760b0d20"
server_key_iv: "e0eb076e700f171d818e0f9d873d24f0"
server_key_version: "encryptionkey@0"
I20260811 02:32:39.170153 24813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "2096e73a149f4fbab1657e86651a6070"
format_stamp: "Formatted at 2026-08-11 02:32:39 on dist-test-slave-7nm7"
server_key: "76a35134b2a2c14778c49dfb760b0d20"
server_key_iv: "e0eb076e700f171d818e0f9d873d24f0"
server_key_version: "encryptionkey@0"
I20260811 02:32:39.171618 24813 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:39.172513 24835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:39.172749 24813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:39.172863 24813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "2096e73a149f4fbab1657e86651a6070"
format_stamp: "Formatted at 2026-08-11 02:32:39 on dist-test-slave-7nm7"
server_key: "76a35134b2a2c14778c49dfb760b0d20"
server_key_iv: "e0eb076e700f171d818e0f9d873d24f0"
server_key_version: "encryptionkey@0"
I20260811 02:32:39.172953 24813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:39.203550 24813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:39.205464 24813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:39.205626 24813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:39.205883 24813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:39.206210 24813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:39.206316 24813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:39.206362 24813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:39.206389 24813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:39.212590 24813 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:42729
I20260811 02:32:39.212635 25035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:42729 every 8 connection(s)
I20260811 02:32:39.212977 24813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:39.217195 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24813
I20260811 02:32:39.217303 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:39.217504 17724 external_mini_cluster.cc:1428] Setting key 5c897b1e9888eb6d52eeb7d15c21270a
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[24171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415559, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:39.222518 24350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:39.213752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:35725 (local address 127.17.79.62:35693)
0811 02:32:39.213820 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:39.213823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:39.214032 (+ 209us) server_negotiation.cc:407] Connection header received
0811 02:32:39.214982 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:39.214983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:39.214993 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:39.215041 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:39.215605 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.216088 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.217285 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.217519 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.217601 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:39.219858 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:39.219859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:39.219859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:39.219865 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:39.221264 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.221656 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.221657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.221657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.221709 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.221930 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.221930 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.221931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.222026 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:39.222075 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:39.222392 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 02:32:39.222456 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 02:32:39.222687 25039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:39.213738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35693 (local address 127.17.79.3:35725)
0811 02:32:39.213909 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:39.213946 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:39.214893 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:39.215100 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:39.215104 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:39.215352 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:39.215534 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:39.215538 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.216196 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.216197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:39.217165 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:39.217169 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.217634 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.217635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:39.217762 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:39.218361 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:39.218369 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:39.219767 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:39.221348 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:39.221354 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:39.221356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:39.221585 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:39.221770 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:39.221770 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:39.221771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:39.221871 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:39.222083 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:39.222088 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:39.222199 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 02:32:39.222362 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 02:32:39.222489 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260811 02:32:39.223181 25036 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35693
I20260811 02:32:39.223275 25036 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:39.223421 25036 heartbeater.cc:511] Master 127.17.79.62:35693 requested a full tablet report, sending...
I20260811 02:32:39.223780 24242 ts_manager.cc:194] Registered new tserver with Master: 2096e73a149f4fbab1657e86651a6070 (127.17.79.3:42729)
I20260811 02:32:39.224133 24242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:35725
I20260811 02:32:39.229354 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[24171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[24171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:39.253384 25045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:39.245518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46998 (local address 127.17.79.1:39005)
0811 02:32:39.245692 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:39.245699 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:39.245711 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:39.245746 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:39.245748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:39.245762 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:39.245834 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:39.246457 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.247216 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.247904 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.248221 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.248276 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:39.250616 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:39.250624 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:39.250624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:39.250630 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:39.252240 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.252588 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.252591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.252591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.252666 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.252889 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.252890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.252890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.253023 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:39.253167 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:39.253202 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 02:32:39.253269 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[24171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:39.261523 24350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:39.254799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47738 (local address 127.17.79.62:35693)
0811 02:32:39.254863 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:39.254865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:39.254890 (+ 25us) server_negotiation.cc:407] Connection header received
0811 02:32:39.254970 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:39.254971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:39.254982 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:39.255054 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:39.255517 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.255999 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.256676 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:39.256880 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:39.256956 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:39.259160 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:39.259161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:39.259162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:39.259181 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:39.260536 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.260825 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.260826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.260826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.260877 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:39.261019 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:39.261020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:39.261020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:39.261145 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:39.261224 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:39.261295 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 02:32:39.261352 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 02:32:39.261770 24242 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47738
I20260811 02:32:39.262153 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24355
I20260811 02:32:39.274197 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24587
I20260811 02:32:39.287062 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24813
I20260811 02:32:39.300361 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24191
2026-08-11T02:32:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2161 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[25051](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[25051](info): set up 2 sockets
Aug 11 02:32:39 dist-test-slave-7nm7 krb5kdc[25051](info): commencing operation
krb5kdc: starting...
W20260811 02:32:40.591794 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:40 dist-test-slave-7nm7 krb5kdc[25051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:40.716333 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44889
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:44889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:40.798158 25073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:40.798476 25073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:40.798516 25073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:40.799721 25073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:40.799795 25073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:40.799820 25073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:40.799844 25073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:40.799887 25073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:40.801465 25073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:44889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:40.801769 25073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:40.802018 25073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:40.808789 25084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:40.808806 25088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:40.808808 25083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:40.809253 25073 server_base.cc:1034] running on GCE node
I20260811 02:32:40.809551 25073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:40.809871 25073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:40.811043 25073 hybrid_clock.cc:648] HybridClock initialized: now 1786415560811015 us; error 42 us; skew 500 ppm
Aug 11 02:32:40 dist-test-slave-7nm7 krb5kdc[25051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415560, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:40.814009 25073 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:40.814442 25073 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:40.814519 25073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:40.814675 25073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:40.815806 25073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8"
format_stamp: "Formatted at 2026-08-11 02:32:40 on dist-test-slave-7nm7"
server_key: "74454de79a3af7080848b5fddb44b8c9"
server_key_iv: "6011d3116e55c879a430d0a0df184513"
server_key_version: "encryptionkey@0"
I20260811 02:32:40.816187 25073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8"
format_stamp: "Formatted at 2026-08-11 02:32:40 on dist-test-slave-7nm7"
server_key: "74454de79a3af7080848b5fddb44b8c9"
server_key_iv: "6011d3116e55c879a430d0a0df184513"
server_key_version: "encryptionkey@0"
I20260811 02:32:40.817615 25073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:40.818701 25095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:40.818889 25073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:40.819010 25073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8"
format_stamp: "Formatted at 2026-08-11 02:32:40 on dist-test-slave-7nm7"
server_key: "74454de79a3af7080848b5fddb44b8c9"
server_key_iv: "6011d3116e55c879a430d0a0df184513"
server_key_version: "encryptionkey@0"
I20260811 02:32:40.819087 25073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:40.830088 25073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:40.832358 25073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:40.832535 25073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:40.836761 25073 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:44889
I20260811 02:32:40.836793 25193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:44889 every 8 connection(s)
I20260811 02:32:40.837090 25073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:40.838317 25195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:40.840656 25195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8: Bootstrap starting.
I20260811 02:32:40.841254 25195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:40.841324 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 25073
I20260811 02:32:40.841464 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:40.841650 25195 log.cc:824] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:40.841686 17724 external_mini_cluster.cc:1428] Setting key 5e6f67cdb010dd2222629fd7f16e92e3
I20260811 02:32:40.842576 25195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8: No bootstrap required, opened a new log
I20260811 02:32:40.845438 25195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44889 } }
I20260811 02:32:40.845736 25195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:40.845784 25195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cb0ebcf88da4b12a53027c2d6bbcaf8, State: Initialized, Role: FOLLOWER
I20260811 02:32:40.845997 25195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44889 } }
I20260811 02:32:40.846112 25195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:40.846184 25195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:40.846272 25195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:40.847568 25195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44889 } }
I20260811 02:32:40.847694 25195 leader_election.cc:302] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cb0ebcf88da4b12a53027c2d6bbcaf8; no voters:
I20260811 02:32:40.847960 25195 leader_election.cc:288] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:40.848022 25205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:40.848199 25205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [term 1 LEADER]: Becoming Leader. State: Replica: 5cb0ebcf88da4b12a53027c2d6bbcaf8, State: Running, Role: LEADER
I20260811 02:32:40.848284 25195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:40.848407 25205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44889 } }
Aug 11 02:32:40 dist-test-slave-7nm7 krb5kdc[25051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:40.848820 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cb0ebcf88da4b12a53027c2d6bbcaf8. Latest consensus state: current_term: 1 leader_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44889 } } }
I20260811 02:32:40.848831 25206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cb0ebcf88da4b12a53027c2d6bbcaf8" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44889 } } }
I20260811 02:32:40.848933 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:40.848937 25206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:40.849716 25218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:40.850327 25218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:40.852015 25218 catalog_manager.cc:1347] Generated new cluster ID: eb101d7a57254ffa9eb8400c30ccc953
I20260811 02:32:40.852108 25218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:40.853590 25203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:40.842209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59218 (local address 127.17.79.62:44889)
0811 02:32:40.842442 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:40.842451 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:40.842480 (+ 29us) server_negotiation.cc:407] Connection header received
0811 02:32:40.842978 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:40.842985 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:40.843033 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:40.843183 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:40.843841 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:40.844759 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:40.845543 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:40.846056 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:40.846185 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:40.849241 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:40.849245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:40.849246 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:40.849258 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:40.851487 (+ 2229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:40.851862 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:40.851867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:40.851868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:40.851984 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:40.852228 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:40.852229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:40.852230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:40.852531 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:40.852697 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:40.853240 (+ 543us) server_negotiation.cc:299] Negotiation successful
0811 02:32:40.853379 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":116,"threads_started":1}
I20260811 02:32:40.872421 25218 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:40.872994 25218 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:40.882261 25218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8: Generated new TSK 0
I20260811 02:32:40.882453 25218 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:40.909679 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44889
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:40.992478 25243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:40.992681 25243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:40.992707 25243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:40.993773 25243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:40.993808 25243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:40.993832 25243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:40.995368 25243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:40.995555 25243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:40.995733 25243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:41.000842 25254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:41.000958 25243 server_base.cc:1034] running on GCE node
W20260811 02:32:41.000864 25252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.001045 25251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:41.001298 25243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:41.001499 25243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:41.002674 25243 hybrid_clock.cc:648] HybridClock initialized: now 1786415561002652 us; error 38 us; skew 500 ppm
Aug 11 02:32:41 dist-test-slave-7nm7 krb5kdc[25051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415561, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:41.005371 25243 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:41.005713 25243 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:41.005789 25243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:41.005939 25243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:41.007217 25243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "a2043803674b4abc9782b21002662115"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "cd7fffad181a5424a3c0c69fa6e403a5"
server_key_iv: "5e41a7c6d4836c70ba86d46a62608908"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.007582 25243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "a2043803674b4abc9782b21002662115"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "cd7fffad181a5424a3c0c69fa6e403a5"
server_key_iv: "5e41a7c6d4836c70ba86d46a62608908"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.008888 25243 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:32:41.009624 25262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.009795 25243 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:41.009902 25243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "a2043803674b4abc9782b21002662115"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "cd7fffad181a5424a3c0c69fa6e403a5"
server_key_iv: "5e41a7c6d4836c70ba86d46a62608908"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.009975 25243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:41.034689 25243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:41.037046 25243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:41.037218 25243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:41.037475 25243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:41.037808 25243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:41.037864 25243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.037910 25243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:41.037945 25243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.043834 25243 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:38795
I20260811 02:32:41.043900 25459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:38795 every 8 connection(s)
I20260811 02:32:41.044185 25243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:41.045102 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 25243
I20260811 02:32:41.045243 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:41.045421 17724 external_mini_cluster.cc:1428] Setting key e755d58732307e0e89eaecb58cce298f
Aug 11 02:32:41 dist-test-slave-7nm7 krb5kdc[25051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415561, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
I20260811 02:32:41.054715 25203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.044948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:46611 (local address 127.17.79.62:44889)
0811 02:32:41.044993 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.044995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.045420 (+ 425us) server_negotiation.cc:407] Connection header received
0811 02:32:41.045984 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.045985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.045998 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.046054 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:41.047150 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.047667 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.048818 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.049139 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.049227 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.051742 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:41.051743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:41.051744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:41.051751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:41.053252 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.053674 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.053676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.053677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.053739 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.054024 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.054027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.054028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.054140 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:41.054215 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.054517 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.054624 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:32:41.054991 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.044946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44889 (local address 127.17.79.1:46611)
0811 02:32:41.045250 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.045315 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.045857 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.046133 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.046137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.046480 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:41.047045 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.047050 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.047770 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.047771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.048719 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.048722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.049241 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.049242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.049383 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.049956 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:41.049964 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:41.051646 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:41.053353 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:41.053360 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:41.053362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:41.053580 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:41.053812 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:41.053813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:41.053814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:41.053920 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:41.054218 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:41.054225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:41.054383 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.054496 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.054649 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":126,"threads_started":1}
I20260811 02:32:41.055512 25461 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44889
I20260811 02:32:41.055611 25461 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:41.055729 25461 heartbeater.cc:511] Master 127.17.79.62:44889 requested a full tablet report, sending...
I20260811 02:32:41.056211 25125 ts_manager.cc:194] Registered new tserver with Master: a2043803674b4abc9782b21002662115 (127.17.79.1:38795)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
I20260811 02:32:41.057047 25125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:46611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:41.072584 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44889
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:41.154052 25468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:41.154289 25468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:41.154364 25468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:41.155485 25468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:41.155524 25468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:41.155550 25468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:41.157140 25468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:41.157378 25468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:41.157626 25468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:41.162647 25477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.162654 25474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.162711 25475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:41.162954 25468 server_base.cc:1034] running on GCE node
I20260811 02:32:41.163179 25468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:41.163384 25468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:41.164584 25468 hybrid_clock.cc:648] HybridClock initialized: now 1786415561164559 us; error 37 us; skew 500 ppm
Aug 11 02:32:41 dist-test-slave-7nm7 krb5kdc[25051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415561, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:41.167587 25468 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:41.167956 25468 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:41.168056 25468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:41.168205 25468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:41.169296 25468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "9c43827ef5e542198e4abc29c0c67318"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "6909c74ca2df5a331e8b84cb7a65b796"
server_key_iv: "e9be56cb0b1377bfb7e566e2969759d8"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.169683 25468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "9c43827ef5e542198e4abc29c0c67318"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "6909c74ca2df5a331e8b84cb7a65b796"
server_key_iv: "e9be56cb0b1377bfb7e566e2969759d8"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.171171 25468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:41.171934 25483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.172118 25468 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:41.172227 25468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "9c43827ef5e542198e4abc29c0c67318"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "6909c74ca2df5a331e8b84cb7a65b796"
server_key_iv: "e9be56cb0b1377bfb7e566e2969759d8"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.172307 25468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:41.185338 25468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:41.187585 25468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:41.187780 25468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:41.188040 25468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:41.188395 25468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:41.188454 25468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.188496 25468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:41.188524 25468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.194371 25468 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:34711
I20260811 02:32:41.194604 25688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:34711 every 8 connection(s)
I20260811 02:32:41.194741 25468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:41.197849 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 25468
I20260811 02:32:41.197947 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:41.198217 17724 external_mini_cluster.cc:1428] Setting key 4323ed6688f5701934a1aee1504f9dbc
Aug 11 02:32:41 dist-test-slave-7nm7 krb5kdc[25051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415561, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:41.205941 25203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.195613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:50533 (local address 127.17.79.62:44889)
0811 02:32:41.195661 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.195664 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.195764 (+ 100us) server_negotiation.cc:407] Connection header received
0811 02:32:41.196249 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.196250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.196260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.196326 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:41.197500 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.198092 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.199661 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.200068 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.200154 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.202636 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:41.202637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:41.202637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:41.202645 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:41.204412 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.204838 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.204840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.204841 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.204908 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.205157 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.205158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.205158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.205314 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:41.205399 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.205727 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.205833 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:32:41.205957 25692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.195461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44889 (local address 127.17.79.2:50533)
0811 02:32:41.195643 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.195687 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.196157 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.196559 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.196567 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.196860 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:41.197410 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.197416 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.198196 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.198198 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.199562 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.199565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.200205 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.200206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.200368 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.200940 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:41.200951 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:41.202537 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:41.204500 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:41.204507 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:41.204508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:41.204738 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:41.204989 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:41.204989 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:41.204990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:41.205088 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:41.205410 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:41.205417 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:41.205548 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.205649 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.205784 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":99,"threads_started":1}
I20260811 02:32:41.206670 25690 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44889
I20260811 02:32:41.206766 25690 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:41.206885 25690 heartbeater.cc:511] Master 127.17.79.62:44889 requested a full tablet report, sending...
I20260811 02:32:41.207278 25125 ts_manager.cc:194] Registered new tserver with Master: 9c43827ef5e542198e4abc29c0c67318 (127.17.79.2:34711)
I20260811 02:32:41.207672 25125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:50533
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:41.228715 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44889
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:41.310724 25696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:41.310978 25696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:41.311021 25696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:41.312146 25696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:41.312224 25696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:41.312278 25696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:41.313853 25696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44889
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:41.314109 25696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:41.314365 25696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:41.319391 25702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.319406 25709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:41.319527 25696 server_base.cc:1034] running on GCE node
W20260811 02:32:41.319427 25713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:41.319792 25696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:41.319989 25696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:41.321134 25696 hybrid_clock.cc:648] HybridClock initialized: now 1786415561321121 us; error 32 us; skew 500 ppm
Aug 11 02:32:41 dist-test-slave-7nm7 krb5kdc[25051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415561, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:41.323712 25696 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:41.324077 25696 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:41.324131 25696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:41.324257 25696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:41.325301 25696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "8da6f603437a4cc98f32a073935d6ef6"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "86a6e8070921ec987aaf6d8494e16443"
server_key_iv: "f3496947d1f3cb0faea0befdaab9d13a"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.325665 25696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "8da6f603437a4cc98f32a073935d6ef6"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "86a6e8070921ec987aaf6d8494e16443"
server_key_iv: "f3496947d1f3cb0faea0befdaab9d13a"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.327036 25696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:41.327755 25722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.327921 25696 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:41.328032 25696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "8da6f603437a4cc98f32a073935d6ef6"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "86a6e8070921ec987aaf6d8494e16443"
server_key_iv: "f3496947d1f3cb0faea0befdaab9d13a"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.328104 25696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:41.344455 25696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:41.346520 25696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:41.346695 25696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:41.346949 25696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:41.347270 25696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:41.347324 25696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.347366 25696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:41.347396 25696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.353767 25696 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:38415
I20260811 02:32:41.353806 25929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:38415 every 8 connection(s)
I20260811 02:32:41.354069 25696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:41.354374 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 25696
I20260811 02:32:41.354463 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:41.354686 17724 external_mini_cluster.cc:1428] Setting key ac8cc22d230bc6b2508547aebecb4e69
Aug 11 02:32:41 dist-test-slave-7nm7 krb5kdc[25051](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415561, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:41.363132 25203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.354798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:59851 (local address 127.17.79.62:44889)
0811 02:32:41.354846 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.354849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.355099 (+ 250us) server_negotiation.cc:407] Connection header received
0811 02:32:41.355682 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.355684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.355695 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.355740 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:41.356667 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.357171 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.358169 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.358413 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.358489 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.360658 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:41.360668 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:41.360668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:41.360674 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:41.361946 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.362397 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.362397 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.362398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.362449 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.362668 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.362669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.362669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.362766 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:41.362817 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.363013 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.363071 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:41.363355 25935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.354791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44889 (local address 127.17.79.3:59851)
0811 02:32:41.354970 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.355019 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.355597 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.355804 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.355808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.356073 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:41.356567 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.356572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.357267 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.357269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.358061 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.358064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.358496 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.358497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.358621 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.359088 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:41.359099 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:41.360553 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:41.362034 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:41.362041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:41.362042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:41.362333 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:41.362509 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:41.362509 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:41.362510 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:41.362608 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:41.362821 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:41.362825 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:41.362927 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.363003 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.363113 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260811 02:32:41.363924 25932 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44889
I20260811 02:32:41.364003 25932 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:41.364122 25932 heartbeater.cc:511] Master 127.17.79.62:44889 requested a full tablet report, sending...
I20260811 02:32:41.364447 25125 ts_manager.cc:194] Registered new tserver with Master: 8da6f603437a4cc98f32a073935d6ef6 (127.17.79.3:38415)
I20260811 02:32:41.364825 25125 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:59851
I20260811 02:32:41.366407 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:32:41.374917 25203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.369156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59228 (local address 127.17.79.62:44889)
0811 02:32:41.369217 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.369218 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.369343 (+ 125us) server_negotiation.cc:407] Connection header received
0811 02:32:41.369379 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.369379 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.369387 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.369441 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:41.369940 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.370461 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.371126 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.371308 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.371361 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.372379 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:41.372381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:41.372381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:41.372387 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:41.373730 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.374102 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.374103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.374103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.374181 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:41.374486 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:41.374487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:41.374488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:41.374628 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:41.374714 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.374803 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.374859 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:32:41.376507 25125 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59228:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:41.378022 25125 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:41.384469 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.380137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:34711 (local address 127.0.0.1:44248)
0811 02:32:41.380589 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.380596 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.380657 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.380922 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.380925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.380928 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:41.381015 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.381018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.382026 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.382027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.383288 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.383291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.384131 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.384132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.384223 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.384237 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.384339 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.384394 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":7,"thread_start_us":83,"threads_started":1}
I20260811 02:32:41.384482 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.380252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44248 (local address 127.17.79.2:34711)
0811 02:32:41.380391 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.380396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.380664 (+ 268us) server_negotiation.cc:407] Connection header received
0811 02:32:41.380719 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.380722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.380742 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.380817 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:41.381103 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.381918 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.383376 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.384027 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.384123 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.384187 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.384360 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.384404 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260811 02:32:41.384781 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.380133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:38795 (local address 127.0.0.1:42740)
0811 02:32:41.380416 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.380452 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.380517 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.380927 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.380928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.380929 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:41.381172 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.381174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.382502 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.382504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.383561 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.383563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.384520 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.384521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.384594 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.384599 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.384662 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.384700 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":191,"thread_start_us":80,"threads_started":1}
I20260811 02:32:41.384838 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.380601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42740 (local address 127.17.79.1:38795)
0811 02:32:41.380759 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.380763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.380774 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:41.380814 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.380816 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.380833 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.380934 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:41.381255 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.382391 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.383644 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.384355 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.384427 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.384480 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.384687 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.384755 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260811 02:32:41.385318 25947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.380137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:38415 (local address 127.0.0.1:40586)
0811 02:32:41.380723 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.380731 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.380780 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.380955 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.380955 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.380956 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:41.381015 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.381017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.382541 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.382542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.383598 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.383601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.385057 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.385058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.385123 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.385127 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.385212 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.385252 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":5,"thread_start_us":69,"threads_started":1}
I20260811 02:32:41.385344 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.380398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40586 (local address 127.17.79.3:38415)
0811 02:32:41.380550 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.380554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.380780 (+ 226us) server_negotiation.cc:407] Connection header received
0811 02:32:41.380852 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.380855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.380871 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.380947 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:41.381290 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.382432 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.383709 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.384355 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.384428 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.384494 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.385228 (+ 734us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.385270 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":95,"threads_started":1}
I20260811 02:32:41.385258 25561 tablet_service.cc:1467] Processing CreateTablet for tablet 8f539f1f61904ec7b436caa2e2464cb0 (DEFAULT_TABLE table=test-table [id=c0481fdc9068471b983ab900a2bcca1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:41.385497 25347 tablet_service.cc:1467] Processing CreateTablet for tablet 8f539f1f61904ec7b436caa2e2464cb0 (DEFAULT_TABLE table=test-table [id=c0481fdc9068471b983ab900a2bcca1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:41.385629 25561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f539f1f61904ec7b436caa2e2464cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:41.385831 25347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f539f1f61904ec7b436caa2e2464cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:41.386220 25810 tablet_service.cc:1467] Processing CreateTablet for tablet 8f539f1f61904ec7b436caa2e2464cb0 (DEFAULT_TABLE table=test-table [id=c0481fdc9068471b983ab900a2bcca1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:41.386603 25810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f539f1f61904ec7b436caa2e2464cb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:41.388940 25952 tablet_bootstrap.cc:492] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Bootstrap starting.
I20260811 02:32:41.389377 25955 tablet_bootstrap.cc:492] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: Bootstrap starting.
I20260811 02:32:41.389762 25952 tablet_bootstrap.cc:654] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:41.390026 25955 tablet_bootstrap.cc:654] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:41.390386 25956 tablet_bootstrap.cc:492] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Bootstrap starting.
I20260811 02:32:41.390444 25952 log.cc:824] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:41.390676 25955 log.cc:824] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:41.391026 25956 tablet_bootstrap.cc:654] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:41.391330 25952 tablet_bootstrap.cc:492] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: No bootstrap required, opened a new log
I20260811 02:32:41.391386 25952 ts_tablet_manager.cc:1397] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:32:41.391592 25956 log.cc:824] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:41.392372 25956 tablet_bootstrap.cc:492] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: No bootstrap required, opened a new log
I20260811 02:32:41.392452 25956 ts_tablet_manager.cc:1397] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:41.392926 25952 raft_consensus.cc:348] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.393054 25952 raft_consensus.cc:374] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:41.393075 25952 raft_consensus.cc:729] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8da6f603437a4cc98f32a073935d6ef6, State: Initialized, Role: FOLLOWER
I20260811 02:32:41.393214 25952 consensus_queue.cc:260] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.393496 25952 ts_tablet_manager.cc:1428] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:41.393520 25932 heartbeater.cc:503] Master 127.17.79.62:44889 was elected leader, sending a full tablet report...
I20260811 02:32:41.393862 25955 tablet_bootstrap.cc:492] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: No bootstrap required, opened a new log
I20260811 02:32:41.393929 25955 ts_tablet_manager.cc:1397] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 02:32:41.394357 25956 raft_consensus.cc:348] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.394552 25956 raft_consensus.cc:374] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:41.394598 25956 raft_consensus.cc:729] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c43827ef5e542198e4abc29c0c67318, State: Initialized, Role: FOLLOWER
I20260811 02:32:41.394713 25956 consensus_queue.cc:260] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.394997 25956 ts_tablet_manager.cc:1428] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:41.395167 25690 heartbeater.cc:503] Master 127.17.79.62:44889 was elected leader, sending a full tablet report...
I20260811 02:32:41.395725 25955 raft_consensus.cc:348] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.395876 25955 raft_consensus.cc:374] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:41.395901 25955 raft_consensus.cc:729] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2043803674b4abc9782b21002662115, State: Initialized, Role: FOLLOWER
I20260811 02:32:41.396005 25955 consensus_queue.cc:260] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.396275 25955 ts_tablet_manager.cc:1428] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 02:32:41.396299 25461 heartbeater.cc:503] Master 127.17.79.62:44889 was elected leader, sending a full tablet report...
W20260811 02:32:41.445324 25691 tablet.cc:2369] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:32:41.544922 25463 tablet.cc:2369] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:32:41.604729 25934 tablet.cc:2369] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:41.636730 25965 raft_consensus.cc:482] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:41.636922 25965 raft_consensus.cc:504] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.637347 25965 leader_election.cc:288] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2043803674b4abc9782b21002662115 (127.17.79.1:38795), 8da6f603437a4cc98f32a073935d6ef6 (127.17.79.3:38415)
I20260811 02:32:41.640432 25692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.637588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:38415 (local address 127.17.79.2:59499)
0811 02:32:41.637651 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.637664 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.637718 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.637924 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.637925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.637927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:41.638019 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.638022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.638760 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.638761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.639551 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.639553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.640144 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.640146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.640245 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.640249 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.640293 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.640348 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 02:32:41.640460 25968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.637593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:38795 (local address 127.17.79.2:51805)
0811 02:32:41.637892 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.637905 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:41.637973 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:41.638114 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:41.638115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:41.638116 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:41.638188 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.638189 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.638860 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.638861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.639633 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:41.639636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.640196 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.640197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:41.640260 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.640264 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:41.640340 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 02:32:41.640376 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":88,"thread_start_us":136,"threads_started":1}
I20260811 02:32:41.640442 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.637700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:59499 (local address 127.17.79.3:38415)
0811 02:32:41.637750 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.637752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.637762 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:41.637793 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.637794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.637810 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.637896 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:41.638119 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.638678 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.639651 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.640054 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.640109 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.640118 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.640324 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.640367 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:32:41.640482 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.637700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:51805 (local address 127.17.79.1:38795)
0811 02:32:41.637750 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.637752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.637981 (+ 229us) server_negotiation.cc:407] Connection header received
0811 02:32:41.638015 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.638016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.638030 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.638088 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:41.638283 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.638776 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.639730 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.640072 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.640166 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.640177 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.640363 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.640409 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:32:41.640898 25848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f539f1f61904ec7b436caa2e2464cb0" candidate_uuid: "9c43827ef5e542198e4abc29c0c67318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8da6f603437a4cc98f32a073935d6ef6" is_pre_election: true
I20260811 02:32:41.640904 25378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f539f1f61904ec7b436caa2e2464cb0" candidate_uuid: "9c43827ef5e542198e4abc29c0c67318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2043803674b4abc9782b21002662115" is_pre_election: true
I20260811 02:32:41.641067 25848 raft_consensus.cc:2454] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c43827ef5e542198e4abc29c0c67318 in term 0.
I20260811 02:32:41.641072 25378 raft_consensus.cc:2454] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c43827ef5e542198e4abc29c0c67318 in term 0.
I20260811 02:32:41.641333 25486 leader_election.cc:302] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c43827ef5e542198e4abc29c0c67318, a2043803674b4abc9782b21002662115; no voters:
I20260811 02:32:41.641462 25965 raft_consensus.cc:2781] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:41.641520 25965 raft_consensus.cc:482] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:41.641542 25965 raft_consensus.cc:3037] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:41.642302 25965 raft_consensus.cc:504] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.642449 25965 leader_election.cc:288] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [CANDIDATE]: Term 1 election: Requested vote from peers a2043803674b4abc9782b21002662115 (127.17.79.1:38795), 8da6f603437a4cc98f32a073935d6ef6 (127.17.79.3:38415)
I20260811 02:32:41.642633 25378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f539f1f61904ec7b436caa2e2464cb0" candidate_uuid: "9c43827ef5e542198e4abc29c0c67318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2043803674b4abc9782b21002662115"
I20260811 02:32:41.642623 25848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f539f1f61904ec7b436caa2e2464cb0" candidate_uuid: "9c43827ef5e542198e4abc29c0c67318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8da6f603437a4cc98f32a073935d6ef6"
I20260811 02:32:41.642712 25848 raft_consensus.cc:3037] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:41.642712 25378 raft_consensus.cc:3037] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:41.643617 25378 raft_consensus.cc:2454] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c43827ef5e542198e4abc29c0c67318 in term 1.
I20260811 02:32:41.643617 25848 raft_consensus.cc:2454] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c43827ef5e542198e4abc29c0c67318 in term 1.
I20260811 02:32:41.643812 25485 leader_election.cc:302] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8da6f603437a4cc98f32a073935d6ef6, 9c43827ef5e542198e4abc29c0c67318; no voters:
I20260811 02:32:41.643916 25965 raft_consensus.cc:2781] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:41.644109 25965 raft_consensus.cc:686] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 1 LEADER]: Becoming Leader. State: Replica: 9c43827ef5e542198e4abc29c0c67318, State: Running, Role: LEADER
I20260811 02:32:41.644222 25965 consensus_queue.cc:237] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } }
I20260811 02:32:41.645133 25125 catalog_manager.cc:5495] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c43827ef5e542198e4abc29c0c67318 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "9c43827ef5e542198e4abc29c0c67318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c43827ef5e542198e4abc29c0c67318" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 } health_report { overall_health: UNKNOWN } } }
I20260811 02:32:41.670686 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.668154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44264 (local address 127.17.79.2:34711)
0811 02:32:41.668210 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.668212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.668219 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:41.668254 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.668255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.668277 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.668345 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:41.668532 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.669039 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.669808 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:41.670014 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:41.670077 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:41.670360 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:41.670460 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:41.670530 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.670580 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.670605 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:32:41.672638 25848 raft_consensus.cc:1261] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 1 FOLLOWER]: Refusing update from remote peer 9c43827ef5e542198e4abc29c0c67318: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:41.672735 25378 raft_consensus.cc:1261] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115 [term 1 FOLLOWER]: Refusing update from remote peer 9c43827ef5e542198e4abc29c0c67318: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:41.672982 25965 consensus_queue.cc:1035] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8da6f603437a4cc98f32a073935d6ef6" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:41.673136 25970 consensus_queue.cc:1035] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2043803674b4abc9782b21002662115" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 38795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:41.675599 25977 mvcc.cc:205] Tried to move back new op lower bound from 7317158140608102400 to 7317158140495212544. Current Snapshot: MvccSnapshot[applied={T|T < 7317158140608102400}]
I20260811 02:32:41.675720 25978 mvcc.cc:205] Tried to move back new op lower bound from 7317158140608102400 to 7317158140495212544. Current Snapshot: MvccSnapshot[applied={T|T < 7317158140608102400}]
I20260811 02:32:41.678966 25125 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:41.679064 25125 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:41.679860 25125 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cb0ebcf88da4b12a53027c2d6bbcaf8: Sending DeleteTablet for 3 replicas of tablet 8f539f1f61904ec7b436caa2e2464cb0
I20260811 02:32:41.680199 25561 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f539f1f61904ec7b436caa2e2464cb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:41 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:44248
I20260811 02:32:41.680213 25810 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f539f1f61904ec7b436caa2e2464cb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:41 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:40586
I20260811 02:32:41.680207 25347 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f539f1f61904ec7b436caa2e2464cb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:41 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:42740
I20260811 02:32:41.680434 25993 tablet_replica.cc:330] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: stopping tablet replica
I20260811 02:32:41.680536 25993 raft_consensus.cc:2229] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:41.680642 25993 raft_consensus.cc:2258] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:41.680703 25999 tablet_replica.cc:330] T 8f539f1f61904ec7b436caa2e2464cb0 P a2043803674b4abc9782b21002662115: stopping tablet replica
I20260811 02:32:41.680804 25995 tablet_replica.cc:330] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: stopping tablet replica
I20260811 02:32:41.680791 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 25243
I20260811 02:32:41.680963 25995 raft_consensus.cc:2229] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:41.681104 25995 raft_consensus.cc:2258] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:41.683945 25993 ts_tablet_manager.cc:1905] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:41.685663 25993 ts_tablet_manager.cc:1918] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:41.685739 25993 log.cc:1196] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/8f539f1f61904ec7b436caa2e2464cb0
I20260811 02:32:41.685978 25993 ts_tablet_manager.cc:1939] T 8f539f1f61904ec7b436caa2e2464cb0 P 8da6f603437a4cc98f32a073935d6ef6: Deleting consensus metadata
I20260811 02:32:41.691761 25098 catalog_manager.cc:4841] TS 8da6f603437a4cc98f32a073935d6ef6 (127.17.79.3:38415): tablet 8f539f1f61904ec7b436caa2e2464cb0 (table test-table [id=c0481fdc9068471b983ab900a2bcca1a]) successfully deleted
I20260811 02:32:41.693354 25995 ts_tablet_manager.cc:1905] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:41.694844 25995 ts_tablet_manager.cc:1918] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:41.694952 25995 log.cc:1196] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/8f539f1f61904ec7b436caa2e2464cb0
I20260811 02:32:41.695219 25995 ts_tablet_manager.cc:1939] T 8f539f1f61904ec7b436caa2e2464cb0 P 9c43827ef5e542198e4abc29c0c67318: Deleting consensus metadata
I20260811 02:32:41.695722 25097 catalog_manager.cc:4841] TS 9c43827ef5e542198e4abc29c0c67318 (127.17.79.2:34711): tablet 8f539f1f61904ec7b436caa2e2464cb0 (table test-table [id=c0481fdc9068471b983ab900a2bcca1a]) successfully deleted
W20260811 02:32:41.698738 25102 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:38795 (error 108)
I20260811 02:32:41.699034 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 25468
I20260811 02:32:41.701963 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.699164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:38795 (local address 127.0.0.1:42746)
0811 02:32:41.701872 (+ 2708us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:41.701922 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:38795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2683}
W20260811 02:32:41.707719 25102 catalog_manager.cc:4584] TS a2043803674b4abc9782b21002662115 (127.17.79.1:38795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f539f1f61904ec7b436caa2e2464cb0: Network error: Client connection negotiation failed: client connection to 127.17.79.1:38795: connect: Connection refused (error 111)
I20260811 02:32:41.711252 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 25696
I20260811 02:32:41.724162 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 25073
2026-08-11T02:32:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2425 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T02:32:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:41Z Disabled control of system clock
I20260811 02:32:41.759835 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33319
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:33319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 02:32:41.841981 26004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:41.842216 26004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:41.842263 26004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:41.843335 26004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:41.843371 26004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:41.843384 26004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:41.843396 26004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:41.843408 26004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:41.844688 26004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:33319
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:41.844907 26004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:41.845152 26004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:41.850033 26017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.850018 26018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.850021 26020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:41.850261 26004 server_base.cc:1034] running on GCE node
I20260811 02:32:41.850536 26004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:41.850880 26004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:41.852046 26004 hybrid_clock.cc:648] HybridClock initialized: now 1786415561852021 us; error 38 us; skew 500 ppm
I20260811 02:32:41.857776 26004 webserver.cc:460] Webserver started at http://127.17.79.62:36561/ using document root <none> and password file <none>
I20260811 02:32:41.858069 26004 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:41.858148 26004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:41.858341 26004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:41.859485 26004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "a700643257004ba6884b5843b6c577a9"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "be9e28d7cae8ea714d6a39e2b844aca5"
server_key_iv: "5b334f6c38601571a35de996ec0f1454"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.859862 26004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "a700643257004ba6884b5843b6c577a9"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "be9e28d7cae8ea714d6a39e2b844aca5"
server_key_iv: "5b334f6c38601571a35de996ec0f1454"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.861290 26004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:41.862066 26034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.862320 26004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:41.862452 26004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "a700643257004ba6884b5843b6c577a9"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "be9e28d7cae8ea714d6a39e2b844aca5"
server_key_iv: "5b334f6c38601571a35de996ec0f1454"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.862528 26004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:41.865962 26004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:41.866220 26004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:41.866405 26004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:41.870321 26004 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:33319
I20260811 02:32:41.870352 26121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:33319 every 8 connection(s)
I20260811 02:32:41.870697 26004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:41.871379 26124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:41.874222 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 26004
I20260811 02:32:41.874274 26124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9: Bootstrap starting.
I20260811 02:32:41.874364 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:41.874554 17724 external_mini_cluster.cc:1428] Setting key 94b402fde0c2c05b674013c8926e868f
I20260811 02:32:41.875015 26124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:41.875406 26124 log.cc:824] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:41.876169 26124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9: No bootstrap required, opened a new log
I20260811 02:32:41.877153 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:41.875127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59860 (local address 127.17.79.62:33319)
0811 02:32:41.875349 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:41.875356 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:41.875381 (+ 25us) server_negotiation.cc:407] Connection header received
0811 02:32:41.875850 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:41.875856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:41.875892 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:41.876008 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:41.876697 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:41.876701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:41.876701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:41.876705 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:41.876744 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:41.876754 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:41.876827 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:41.876894 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 02:32:41.876959 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":113,"threads_started":1}
I20260811 02:32:41.878070 26124 raft_consensus.cc:348] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a700643257004ba6884b5843b6c577a9" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33319 } }
I20260811 02:32:41.878232 26124 raft_consensus.cc:374] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:41.878315 26124 raft_consensus.cc:729] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a700643257004ba6884b5843b6c577a9, State: Initialized, Role: FOLLOWER
I20260811 02:32:41.878439 26124 consensus_queue.cc:260] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a700643257004ba6884b5843b6c577a9" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33319 } }
I20260811 02:32:41.878548 26124 raft_consensus.cc:388] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:41.878593 26124 raft_consensus.cc:482] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:41.878643 26124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:41.879464 26124 raft_consensus.cc:504] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a700643257004ba6884b5843b6c577a9" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33319 } }
I20260811 02:32:41.879586 26124 leader_election.cc:302] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a700643257004ba6884b5843b6c577a9; no voters:
I20260811 02:32:41.879776 26124 leader_election.cc:288] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:41.879832 26136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:41.879989 26136 raft_consensus.cc:686] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [term 1 LEADER]: Becoming Leader. State: Replica: a700643257004ba6884b5843b6c577a9, State: Running, Role: LEADER
I20260811 02:32:41.880062 26124 sys_catalog.cc:564] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:41.880122 26136 consensus_queue.cc:237] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a700643257004ba6884b5843b6c577a9" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33319 } }
I20260811 02:32:41.880491 26137 sys_catalog.cc:455] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a700643257004ba6884b5843b6c577a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a700643257004ba6884b5843b6c577a9" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33319 } } }
I20260811 02:32:41.880513 26138 sys_catalog.cc:455] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a700643257004ba6884b5843b6c577a9. Latest consensus state: current_term: 1 leader_uuid: "a700643257004ba6884b5843b6c577a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a700643257004ba6884b5843b6c577a9" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33319 } } }
I20260811 02:32:41.880699 26137 sys_catalog.cc:458] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:41.880707 26138 sys_catalog.cc:458] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:41.881232 26152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:41.881721 26152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:41.883237 26152 catalog_manager.cc:1347] Generated new cluster ID: b501484fbcda4d86afa81249b6879aed
I20260811 02:32:41.883291 26152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:41.888180 26152 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:41.888326 26152 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:41.891815 26152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9: Generated new TSK 0
I20260811 02:32:41.891978 26152 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:32:41.895406 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33319
--builtin_ntp_servers=127.17.79.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 02:32:41.979611 26169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:41.979868 26169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:41.979915 26169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:41.981309 26169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:41.981376 26169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:41.981431 26169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:41.982870 26169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:41.983099 26169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:41.983418 26169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:41.988617 26182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.988565 26179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:41.988564 26180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:41.989023 26169 server_base.cc:1034] running on GCE node
I20260811 02:32:41.989225 26169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:41.989499 26169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:41.990694 26169 hybrid_clock.cc:648] HybridClock initialized: now 1786415561990680 us; error 30 us; skew 500 ppm
I20260811 02:32:41.992182 26169 webserver.cc:460] Webserver started at http://127.17.79.1:45567/ using document root <none> and password file <none>
I20260811 02:32:41.992446 26169 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:41.992512 26169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:41.992643 26169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:41.994083 26169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "e2b9420d53bf48738b7cba4d3671d6be"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "c3162cbf8f8062828e58d489e3dbca4c"
server_key_iv: "377fec88f0472f6c018e42ecbce5971e"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.994526 26169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "e2b9420d53bf48738b7cba4d3671d6be"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "c3162cbf8f8062828e58d489e3dbca4c"
server_key_iv: "377fec88f0472f6c018e42ecbce5971e"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.996248 26169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:32:41.997288 26190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:41.997720 26169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:41.997826 26169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "e2b9420d53bf48738b7cba4d3671d6be"
format_stamp: "Formatted at 2026-08-11 02:32:41 on dist-test-slave-7nm7"
server_key: "c3162cbf8f8062828e58d489e3dbca4c"
server_key_iv: "377fec88f0472f6c018e42ecbce5971e"
server_key_version: "encryptionkey@0"
I20260811 02:32:41.997895 26169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:42.002589 26169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:42.002882 26169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:42.003012 26169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:42.003219 26169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:42.003541 26169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:42.003582 26169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.003613 26169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:42.003631 26169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.011193 26169 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:33875
I20260811 02:32:42.011274 26377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:33875 every 8 connection(s)
I20260811 02:32:42.011622 26169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:42.015410 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.012424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:46283 (local address 127.17.79.62:33319)
0811 02:32:42.012471 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.012473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.012702 (+ 229us) server_negotiation.cc:407] Connection header received
0811 02:32:42.013537 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.013539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.013551 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.013611 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.015100 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.015102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.015103 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.015109 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.015131 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.015136 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.015222 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.015319 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.015337 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:32:42.015618 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.012387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33319 (local address 127.17.79.1:46283)
0811 02:32:42.012575 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.012609 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.013301 (+ 692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.013711 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.013717 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.013738 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.014915 (+ 1177us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.014916 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.014944 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.014977 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.015220 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.015228 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.015230 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.015331 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.015400 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260811 02:32:42.016069 26378 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33319
I20260811 02:32:42.016167 26378 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:42.016319 26378 heartbeater.cc:511] Master 127.17.79.62:33319 requested a full tablet report, sending...
I20260811 02:32:42.016840 26062 ts_manager.cc:194] Registered new tserver with Master: e2b9420d53bf48738b7cba4d3671d6be (127.17.79.1:33875)
I20260811 02:32:42.021394 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 26169
I20260811 02:32:42.021489 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:42.021706 17724 external_mini_cluster.cc:1428] Setting key e93c0695a5aa48a8a472fea3c9f1e066
I20260811 02:32:42.022826 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33319
--builtin_ntp_servers=127.17.79.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 02:32:42.107105 26381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:42.107317 26381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:42.107339 26381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:42.108556 26381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:42.108597 26381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:42.108623 26381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:42.109979 26381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:42.110272 26381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:42.110591 26381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:42.116483 26389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:42.116544 26381 server_base.cc:1034] running on GCE node
W20260811 02:32:42.116488 26394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:42.116457 26400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:42.116986 26381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:42.117285 26381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:42.118432 26381 hybrid_clock.cc:648] HybridClock initialized: now 1786415562118420 us; error 33 us; skew 500 ppm
I20260811 02:32:42.120638 26381 webserver.cc:460] Webserver started at http://127.17.79.2:44319/ using document root <none> and password file <none>
I20260811 02:32:42.120929 26381 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:42.121003 26381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:42.121162 26381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:42.122720 26381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "7e2a5f0c78cd49dd95af723ce4e44e96"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "a21af654edecc0d15123679802923cf5"
server_key_iv: "41e8aa90283d6806a5e775a9c1045e2d"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.123373 26381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "7e2a5f0c78cd49dd95af723ce4e44e96"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "a21af654edecc0d15123679802923cf5"
server_key_iv: "41e8aa90283d6806a5e775a9c1045e2d"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.125420 26381 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:42.126502 26411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.126765 26381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:42.126899 26381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "7e2a5f0c78cd49dd95af723ce4e44e96"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "a21af654edecc0d15123679802923cf5"
server_key_iv: "41e8aa90283d6806a5e775a9c1045e2d"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.126982 26381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:42.130586 26381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:42.130872 26381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:42.131019 26381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:42.131240 26381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:42.131588 26381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:42.131645 26381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.131678 26381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:42.131705 26381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.137753 26381 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46455
I20260811 02:32:42.137806 26607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46455 every 8 connection(s)
I20260811 02:32:42.138126 26381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:42.138603 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 26381
I20260811 02:32:42.138706 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:42.138921 17724 external_mini_cluster.cc:1428] Setting key 8830dc7ec7c6eafb7b094db228b816df
I20260811 02:32:42.140076 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33319
--builtin_ntp_servers=127.17.79.20:43759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 02:32:42.141968 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.139019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:33541 (local address 127.17.79.62:33319)
0811 02:32:42.139157 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.139159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.139521 (+ 362us) server_negotiation.cc:407] Connection header received
0811 02:32:42.140203 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.140204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.140210 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.140242 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.141655 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.141656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.141656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.141665 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.141680 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.141684 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.141734 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.141852 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.141869 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:32:42.142144 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.138997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33319 (local address 127.17.79.2:33541)
0811 02:32:42.139380 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.139425 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.140074 (+ 649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.140310 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.140315 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.140324 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.141490 (+ 1166us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.141490 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.141529 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.141564 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.141754 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.141760 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.141763 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.141847 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.141920 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":81,"threads_started":1}
I20260811 02:32:42.142614 26609 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33319
I20260811 02:32:42.142705 26609 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:42.142823 26609 heartbeater.cc:511] Master 127.17.79.62:33319 requested a full tablet report, sending...
I20260811 02:32:42.143160 26062 ts_manager.cc:194] Registered new tserver with Master: 7e2a5f0c78cd49dd95af723ce4e44e96 (127.17.79.2:46455)
W20260811 02:32:42.224023 26614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:42.224252 26614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:42.224290 26614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:42.225441 26614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:42.225505 26614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:42.225548 26614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:42.226948 26614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:42.227196 26614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:42.227469 26614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:42.232723 26625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:42.232730 26629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:42.232748 26626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:42.232981 26614 server_base.cc:1034] running on GCE node
I20260811 02:32:42.233202 26614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:42.233445 26614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:42.234629 26614 hybrid_clock.cc:648] HybridClock initialized: now 1786415562234612 us; error 32 us; skew 500 ppm
I20260811 02:32:42.235850 26614 webserver.cc:460] Webserver started at http://127.17.79.3:38399/ using document root <none> and password file <none>
I20260811 02:32:42.236141 26614 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:42.236212 26614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:42.236352 26614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:42.237393 26614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "f8d071013ce84b2ab9ad142c9c14cec7"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "badd3459ef92691db13ffe54eb56c4a2"
server_key_iv: "d77b1fbd7c2c07de8c28f75c62c15812"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.237766 26614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "f8d071013ce84b2ab9ad142c9c14cec7"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "badd3459ef92691db13ffe54eb56c4a2"
server_key_iv: "d77b1fbd7c2c07de8c28f75c62c15812"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.239187 26614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:42.239899 26641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.240079 26614 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:42.240200 26614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "f8d071013ce84b2ab9ad142c9c14cec7"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "badd3459ef92691db13ffe54eb56c4a2"
server_key_iv: "d77b1fbd7c2c07de8c28f75c62c15812"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.240291 26614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:42.243655 26614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:42.243916 26614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:42.244059 26614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:42.244285 26614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:42.244583 26614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:42.244638 26614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.244678 26614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:42.244704 26614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.250576 26614 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:38949
I20260811 02:32:42.250627 26824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:38949 every 8 connection(s)
I20260811 02:32:42.250929 26614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:42.253667 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.251638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:33107 (local address 127.17.79.62:33319)
0811 02:32:42.251707 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.251709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.251919 (+ 210us) server_negotiation.cc:407] Connection header received
0811 02:32:42.252351 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.252352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.252357 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.252417 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.253463 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.253464 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.253464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.253468 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.253483 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.253487 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.253534 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.253598 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.253609 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 02:32:42.253816 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.251620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33319 (local address 127.17.79.3:33107)
0811 02:32:42.251795 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.251835 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.252267 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.252464 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.252466 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.252474 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.253320 (+ 846us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.253321 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.253347 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.253373 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.253539 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.253541 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.253543 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.253590 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.253637 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260811 02:32:42.254354 26826 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33319
I20260811 02:32:42.254462 26826 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:42.254609 26826 heartbeater.cc:511] Master 127.17.79.62:33319 requested a full tablet report, sending...
I20260811 02:32:42.254973 26062 ts_manager.cc:194] Registered new tserver with Master: f8d071013ce84b2ab9ad142c9c14cec7 (127.17.79.3:38949)
I20260811 02:32:42.256219 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 26614
I20260811 02:32:42.256309 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:42.256440 17724 external_mini_cluster.cc:1428] Setting key 90f71e73c5b843379b15d47ec17cee88
I20260811 02:32:42.257186 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:32:42.259479 26134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.258505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59874 (local address 127.17.79.62:33319)
0811 02:32:42.258565 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.258567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.258694 (+ 127us) server_negotiation.cc:407] Connection header received
0811 02:32:42.258740 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.258740 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.258744 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.258795 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.259319 (+ 524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.259320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.259320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.259324 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.259336 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.259340 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.259380 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.259420 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.259431 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:32:42.260952 26062 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59874:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:42.262801 26062 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:42.266512 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.264871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:38949 (local address 127.0.0.1:36698)
0811 02:32:42.265306 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.265347 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.265416 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.265572 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.265577 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.265583 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.266079 (+ 496us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.266080 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.266096 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.266118 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.266353 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.266360 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.266363 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.266423 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.266437 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":56,"threads_started":1}
I20260811 02:32:42.266723 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.264885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46455 (local address 127.0.0.1:57136)
0811 02:32:42.265306 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.265347 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.265416 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.265820 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.265821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.265824 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.266294 (+ 470us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.266294 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.266302 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.266315 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.266573 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.266574 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.266575 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.266622 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.266636 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":87,"threads_started":1}
I20260811 02:32:42.266808 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.264963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36698 (local address 127.17.79.3:38949)
0811 02:32:42.265108 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.265112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.265424 (+ 312us) server_negotiation.cc:407] Connection header received
0811 02:32:42.265476 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.265478 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.265487 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.265574 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.266185 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.266193 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.266193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.266197 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.266247 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.266269 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.266324 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.266702 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.266718 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260811 02:32:42.267026 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.265114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57136 (local address 127.17.79.2:46455)
0811 02:32:42.265358 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.265361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.265420 (+ 59us) server_negotiation.cc:407] Connection header received
0811 02:32:42.265482 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.265484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.265492 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.265574 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.266411 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.266418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.266418 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.266423 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.266458 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.266479 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.266548 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.266882 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.266900 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":97,"threads_started":1}
I20260811 02:32:42.267376 26853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.264893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33875 (local address 127.0.0.1:60562)
0811 02:32:42.265510 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.265518 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.265556 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.266547 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.266549 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.266552 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.266985 (+ 433us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.266986 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.266992 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.267003 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.267250 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.267251 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.267252 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.267305 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.267318 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":87,"threads_started":1}
I20260811 02:32:42.267550 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.265114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60562 (local address 127.17.79.1:33875)
0811 02:32:42.265286 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.265289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.265610 (+ 321us) server_negotiation.cc:407] Connection header received
0811 02:32:42.265640 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.265642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.265652 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.265723 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.267099 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.267107 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.267108 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.267112 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.267146 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.267170 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.267224 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.267320 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.267338 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260811 02:32:42.267462 26718 tablet_service.cc:1467] Processing CreateTablet for tablet 3b7e9ffe1d27402fbb0a807c12c66407 (DEFAULT_TABLE table=test-table [id=3b92cc98c5bf4c3aa2391e046722ab97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:42.267850 26718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b7e9ffe1d27402fbb0a807c12c66407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:42.267652 26500 tablet_service.cc:1467] Processing CreateTablet for tablet 3b7e9ffe1d27402fbb0a807c12c66407 (DEFAULT_TABLE table=test-table [id=3b92cc98c5bf4c3aa2391e046722ab97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:42.268187 26500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b7e9ffe1d27402fbb0a807c12c66407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:42.268236 26266 tablet_service.cc:1467] Processing CreateTablet for tablet 3b7e9ffe1d27402fbb0a807c12c66407 (DEFAULT_TABLE table=test-table [id=3b92cc98c5bf4c3aa2391e046722ab97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:42.268553 26266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b7e9ffe1d27402fbb0a807c12c66407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:42.271032 26858 tablet_bootstrap.cc:492] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: Bootstrap starting.
I20260811 02:32:42.271196 26859 tablet_bootstrap.cc:492] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Bootstrap starting.
I20260811 02:32:42.271739 26858 tablet_bootstrap.cc:654] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:42.271720 26860 tablet_bootstrap.cc:492] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be: Bootstrap starting.
I20260811 02:32:42.271924 26859 tablet_bootstrap.cc:654] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:42.272082 26858 log.cc:824] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:42.272250 26859 log.cc:824] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:42.272426 26860 tablet_bootstrap.cc:654] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:42.272766 26860 log.cc:824] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:42.272986 26858 tablet_bootstrap.cc:492] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: No bootstrap required, opened a new log
I20260811 02:32:42.273061 26859 tablet_bootstrap.cc:492] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: No bootstrap required, opened a new log
I20260811 02:32:42.273072 26858 ts_tablet_manager.cc:1397] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:42.273129 26859 ts_tablet_manager.cc:1397] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:42.273518 26860 tablet_bootstrap.cc:492] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be: No bootstrap required, opened a new log
I20260811 02:32:42.273640 26860 ts_tablet_manager.cc:1397] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:42.275199 26858 raft_consensus.cc:348] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.275344 26858 raft_consensus.cc:374] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:42.275388 26858 raft_consensus.cc:729] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2a5f0c78cd49dd95af723ce4e44e96, State: Initialized, Role: FOLLOWER
I20260811 02:32:42.275490 26858 consensus_queue.cc:260] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.275749 26858 ts_tablet_manager.cc:1428] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:42.275910 26609 heartbeater.cc:503] Master 127.17.79.62:33319 was elected leader, sending a full tablet report...
I20260811 02:32:42.275789 26859 raft_consensus.cc:348] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.275957 26859 raft_consensus.cc:374] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:42.275998 26859 raft_consensus.cc:729] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d071013ce84b2ab9ad142c9c14cec7, State: Initialized, Role: FOLLOWER
I20260811 02:32:42.276100 26859 consensus_queue.cc:260] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.276343 26859 ts_tablet_manager.cc:1428] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:42.276260 26860 raft_consensus.cc:348] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.276400 26860 raft_consensus.cc:374] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:42.276445 26860 raft_consensus.cc:729] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b9420d53bf48738b7cba4d3671d6be, State: Initialized, Role: FOLLOWER
I20260811 02:32:42.276456 26826 heartbeater.cc:503] Master 127.17.79.62:33319 was elected leader, sending a full tablet report...
I20260811 02:32:42.276558 26860 consensus_queue.cc:260] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.276800 26860 ts_tablet_manager.cc:1428] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:42.276913 26378 heartbeater.cc:503] Master 127.17.79.62:33319 was elected leader, sending a full tablet report...
W20260811 02:32:42.388785 26610 tablet.cc:2369] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:42.430601 26868 raft_consensus.cc:482] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:42.430752 26868 raft_consensus.cc:504] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.431146 26868 leader_election.cc:288] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2a5f0c78cd49dd95af723ce4e44e96 (127.17.79.2:46455), e2b9420d53bf48738b7cba4d3671d6be (127.17.79.1:33875)
I20260811 02:32:42.432487 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.431328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46455 (local address 127.17.79.3:52277)
0811 02:32:42.431398 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.431411 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.431453 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.431619 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.431620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.431623 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.432059 (+ 436us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.432060 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.432067 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.432101 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.432338 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.432339 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.432340 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.432395 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.432412 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 02:32:42.432494 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.431439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:44681 (local address 127.17.79.1:33875)
0811 02:32:42.431500 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.431502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.431635 (+ 133us) server_negotiation.cc:407] Connection header received
0811 02:32:42.431684 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.431685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.431690 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.431732 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.432264 (+ 532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.432265 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.432266 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.432270 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.432286 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.432291 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.432353 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.432405 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.432421 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 02:32:42.432494 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.431402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:52277 (local address 127.17.79.2:46455)
0811 02:32:42.431455 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.431457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.431496 (+ 39us) server_negotiation.cc:407] Connection header received
0811 02:32:42.431525 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.431526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.431532 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.431583 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.432201 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.432203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.432203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.432207 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.432244 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.432249 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.432316 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.432412 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.432426 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:32:42.432499 26870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.431349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33875 (local address 127.17.79.3:44681)
0811 02:32:42.431559 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.431567 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.431620 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.431758 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.431759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.431761 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:42.432175 (+ 414us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:32:42.432175 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:42.432180 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:32:42.432188 (+ 8us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:42.432352 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:42.432352 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:42.432353 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 02:32:42.432404 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 02:32:42.432413 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":130,"threads_started":1}
I20260811 02:32:42.432889 26537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7e9ffe1d27402fbb0a807c12c66407" candidate_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" is_pre_election: true
I20260811 02:32:42.432958 26300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7e9ffe1d27402fbb0a807c12c66407" candidate_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b9420d53bf48738b7cba4d3671d6be" is_pre_election: true
I20260811 02:32:42.433039 26537 raft_consensus.cc:2454] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d071013ce84b2ab9ad142c9c14cec7 in term 0.
I20260811 02:32:42.433109 26300 raft_consensus.cc:2454] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d071013ce84b2ab9ad142c9c14cec7 in term 0.
I20260811 02:32:42.433279 26646 leader_election.cc:302] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2a5f0c78cd49dd95af723ce4e44e96, f8d071013ce84b2ab9ad142c9c14cec7; no voters:
I20260811 02:32:42.433423 26868 raft_consensus.cc:2781] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:42.433481 26868 raft_consensus.cc:482] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:42.433503 26868 raft_consensus.cc:3037] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:42.434221 26868 raft_consensus.cc:504] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.434433 26868 leader_election.cc:288] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [CANDIDATE]: Term 1 election: Requested vote from peers 7e2a5f0c78cd49dd95af723ce4e44e96 (127.17.79.2:46455), e2b9420d53bf48738b7cba4d3671d6be (127.17.79.1:33875)
I20260811 02:32:42.434608 26300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7e9ffe1d27402fbb0a807c12c66407" candidate_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2b9420d53bf48738b7cba4d3671d6be"
I20260811 02:32:42.434581 26537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b7e9ffe1d27402fbb0a807c12c66407" candidate_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96"
I20260811 02:32:42.434675 26300 raft_consensus.cc:3037] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:42.434695 26537 raft_consensus.cc:3037] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:42.435413 26300 raft_consensus.cc:2454] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d071013ce84b2ab9ad142c9c14cec7 in term 1.
I20260811 02:32:42.435417 26537 raft_consensus.cc:2454] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d071013ce84b2ab9ad142c9c14cec7 in term 1.
I20260811 02:32:42.435601 26648 leader_election.cc:302] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2b9420d53bf48738b7cba4d3671d6be, f8d071013ce84b2ab9ad142c9c14cec7; no voters:
I20260811 02:32:42.435745 26868 raft_consensus.cc:2781] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:42.435914 26868 raft_consensus.cc:686] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 1 LEADER]: Becoming Leader. State: Replica: f8d071013ce84b2ab9ad142c9c14cec7, State: Running, Role: LEADER
I20260811 02:32:42.436014 26868 consensus_queue.cc:237] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } }
I20260811 02:32:42.436913 26061 catalog_manager.cc:5495] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d071013ce84b2ab9ad142c9c14cec7 (127.17.79.3). New cstate: current_term: 1 leader_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d071013ce84b2ab9ad142c9c14cec7" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 38949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 } health_report { overall_health: UNKNOWN } } }
I20260811 02:32:42.448971 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.447838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36700 (local address 127.17.79.3:38949)
0811 02:32:42.447888 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.447890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.447899 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:42.447978 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.447979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.447995 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.448088 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.448744 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.448746 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.448746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.448751 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.448769 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.448774 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.448845 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.448881 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.448895 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:32:42.451232 26537 raft_consensus.cc:1261] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 1 FOLLOWER]: Refusing update from remote peer f8d071013ce84b2ab9ad142c9c14cec7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:42.451232 26300 raft_consensus.cc:1261] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 1 FOLLOWER]: Refusing update from remote peer f8d071013ce84b2ab9ad142c9c14cec7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:42.451740 26871 consensus_queue.cc:1035] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2a5f0c78cd49dd95af723ce4e44e96" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:42.451885 26868 consensus_queue.cc:1035] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2b9420d53bf48738b7cba4d3671d6be" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:42.454317 26877 mvcc.cc:205] Tried to move back new op lower bound from 7317158143797256192 to 7317158143738621952. Current Snapshot: MvccSnapshot[applied={T|T < 7317158143797256192}]
I20260811 02:32:42.454648 26882 mvcc.cc:205] Tried to move back new op lower bound from 7317158143797256192 to 7317158143738621952. Current Snapshot: MvccSnapshot[applied={T|T < 7317158143797256192}]
I20260811 02:32:42.457404 26060 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:42.457506 26060 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59874:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:42.458336 26060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a700643257004ba6884b5843b6c577a9: Sending DeleteTablet for 3 replicas of tablet 3b7e9ffe1d27402fbb0a807c12c66407
I20260811 02:32:42.458688 26266 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b7e9ffe1d27402fbb0a807c12c66407 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:42 UTC) from {username='slave'} at 127.0.0.1:60562
I20260811 02:32:42.458685 26500 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b7e9ffe1d27402fbb0a807c12c66407 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:42 UTC) from {username='slave'} at 127.0.0.1:57136
I20260811 02:32:42.458711 26718 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b7e9ffe1d27402fbb0a807c12c66407 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:42 UTC) from {username='slave'} at 127.0.0.1:36698
I20260811 02:32:42.458931 26897 tablet_replica.cc:330] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be: stopping tablet replica
I20260811 02:32:42.459080 26897 raft_consensus.cc:2229] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:42.459131 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 26169
I20260811 02:32:42.459293 26897 raft_consensus.cc:2258] T 3b7e9ffe1d27402fbb0a807c12c66407 P e2b9420d53bf48738b7cba4d3671d6be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:42.464867 26896 tablet_replica.cc:330] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: stopping tablet replica
I20260811 02:32:42.465082 26896 raft_consensus.cc:2229] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:42.465368 26896 raft_consensus.cc:2258] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:42.470333 26896 ts_tablet_manager.cc:1905] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:42.472472 26896 ts_tablet_manager.cc:1918] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:42.472560 26896 log.cc:1196] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/3b7e9ffe1d27402fbb0a807c12c66407
I20260811 02:32:42.472894 26896 ts_tablet_manager.cc:1939] T 3b7e9ffe1d27402fbb0a807c12c66407 P f8d071013ce84b2ab9ad142c9c14cec7: Deleting consensus metadata
I20260811 02:32:42.473493 26036 catalog_manager.cc:4841] TS f8d071013ce84b2ab9ad142c9c14cec7 (127.17.79.3:38949): tablet 3b7e9ffe1d27402fbb0a807c12c66407 (table test-table [id=3b92cc98c5bf4c3aa2391e046722ab97]) successfully deleted
I20260811 02:32:42.478374 26893 tablet_replica.cc:330] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: stopping tablet replica
I20260811 02:32:42.478524 26893 raft_consensus.cc:2229] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:42.478665 26893 raft_consensus.cc:2258] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:42.479218 26893 ts_tablet_manager.cc:1905] T 3b7e9ffe1d27402fbb0a807c12c66407 P 7e2a5f0c78cd49dd95af723ce4e44e96: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 02:32:42.479449 26039 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:33875 (error 108)
I20260811 02:32:42.479614 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 26381
I20260811 02:32:42.484373 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.484205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33875 (local address 127.0.0.1:60574)
0811 02:32:42.484280 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.484333 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 02:32:42.484513 26039 catalog_manager.cc:4584] TS e2b9420d53bf48738b7cba4d3671d6be (127.17.79.1:33875): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b7e9ffe1d27402fbb0a807c12c66407: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33875: connect: Connection refused (error 111)
I20260811 02:32:42.496562 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.496416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46455 (local address 127.0.0.1:57138)
0811 02:32:42.496479 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.496516 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.2:46455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:32:42.496659 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 26614
I20260811 02:32:42.512775 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 26004
2026-08-11T02:32:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (786 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 02:32:42.537973 17724 mini_oidc.cc:152] Starting JWKS server
I20260811 02:32:42.539271 17724 webserver.cc:460] Webserver started at https://127.0.0.1:43183/ using document root <none> and password file <none>
I20260811 02:32:42.539351 17724 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 02:32:42.539538 17724 webserver.cc:460] Webserver started at http://127.0.0.1:35141/ using document root <none> and password file <none>
2026-08-11T02:32:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:42Z Disabled control of system clock
I20260811 02:32:42.548471 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46249
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:35209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:46249
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43183/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/testchainca.cert with env {}
W20260811 02:32:42.630122 26905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:42.630342 26905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:42.630364 26905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:42.631438 26905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:42.631474 26905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:42.631486 26905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:42.631500 26905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:42.631510 26905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 02:32:42.631523 26905 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 02:32:42.631534 26905 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43183/jwks.json
I20260811 02:32:42.633155 26905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:35209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:46249
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43183/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:42.633349 26905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:42.633510 26905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:42.638388 26917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:42.638391 26918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:42.638384 26920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:42.638545 26905 server_base.cc:1034] running on GCE node
I20260811 02:32:42.638953 26905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:42.639250 26905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:42.640411 26905 hybrid_clock.cc:648] HybridClock initialized: now 1786415562640387 us; error 44 us; skew 500 ppm
I20260811 02:32:42.641610 26905 webserver.cc:460] Webserver started at http://127.17.79.62:34615/ using document root <none> and password file <none>
I20260811 02:32:42.641872 26905 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:42.641917 26905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:42.642081 26905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:42.643149 26905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "57a7cc195d81434486afe2b8d2dee602"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "134b795dc1b50dfe103cf234bfd50af2"
server_key_iv: "78badba48ce89ef2392778b57e02715f"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.643508 26905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "57a7cc195d81434486afe2b8d2dee602"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "134b795dc1b50dfe103cf234bfd50af2"
server_key_iv: "78badba48ce89ef2392778b57e02715f"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.644830 26905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:32:42.645605 26929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.645798 26905 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:42.645885 26905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "57a7cc195d81434486afe2b8d2dee602"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "134b795dc1b50dfe103cf234bfd50af2"
server_key_iv: "78badba48ce89ef2392778b57e02715f"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.645938 26905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:42.679005 26905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:42.679296 26905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:42.679405 26905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:42.683255 26905 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:46249
I20260811 02:32:42.683332 27021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:46249 every 8 connection(s)
I20260811 02:32:42.683663 26905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:42.684762 27022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:42.687008 27022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602: Bootstrap starting.
I20260811 02:32:42.687561 27022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:42.687798 27022 log.cc:824] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:42.688449 27022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602: No bootstrap required, opened a new log
I20260811 02:32:42.689932 27022 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a7cc195d81434486afe2b8d2dee602" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46249 } }
I20260811 02:32:42.690065 27022 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:42.690088 27022 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57a7cc195d81434486afe2b8d2dee602, State: Initialized, Role: FOLLOWER
I20260811 02:32:42.690197 27022 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a7cc195d81434486afe2b8d2dee602" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46249 } }
I20260811 02:32:42.690300 27022 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:42.690340 27022 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:42.690397 27022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:42.690891 27022 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a7cc195d81434486afe2b8d2dee602" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46249 } }
I20260811 02:32:42.691013 27022 leader_election.cc:302] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57a7cc195d81434486afe2b8d2dee602; no voters:
I20260811 02:32:42.691211 27022 leader_election.cc:288] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:42.691267 27028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:42.691438 27028 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [term 1 LEADER]: Becoming Leader. State: Replica: 57a7cc195d81434486afe2b8d2dee602, State: Running, Role: LEADER
I20260811 02:32:42.691470 27022 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:42.691550 27028 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a7cc195d81434486afe2b8d2dee602" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46249 } }
I20260811 02:32:42.691933 27033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57a7cc195d81434486afe2b8d2dee602" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a7cc195d81434486afe2b8d2dee602" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46249 } } }
I20260811 02:32:42.692010 27035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57a7cc195d81434486afe2b8d2dee602. Latest consensus state: current_term: 1 leader_uuid: "57a7cc195d81434486afe2b8d2dee602" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57a7cc195d81434486afe2b8d2dee602" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46249 } } }
I20260811 02:32:42.692036 27033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:42.692093 27035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:42.692608 27048 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:42.693130 27048 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:42.693367 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 26905
I20260811 02:32:42.693487 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:42.693676 17724 external_mini_cluster.cc:1428] Setting key 39615377eb9f27d43a16d81e95ff20d8
I20260811 02:32:42.695649 27048 catalog_manager.cc:1347] Generated new cluster ID: a2f4e9b9e2394ac9a69ee9124d7ba534
I20260811 02:32:42.695700 27048 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:42.699043 27069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.694113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.17.79.62:46249)
0811 02:32:42.694745 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.694752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.694776 (+ 24us) server_negotiation.cc:407] Connection header received
0811 02:32:42.694858 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.694863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.694912 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.695059 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.695288 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.696180 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.697046 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.697493 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.697637 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:42.698361 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.698364 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.698365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.698546 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.698577 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.698588 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.698669 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.698753 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.698832 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":85,"threads_started":1}
I20260811 02:32:42.699901 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:32:42.704311 27048 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:42.704977 27048 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:42.712047 27048 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57a7cc195d81434486afe2b8d2dee602: Generated new TSK 0
I20260811 02:32:42.712229 27048 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 02:32:42.747008 27082 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 02:32:42.747259 27082 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260811 02:32:42.747663 27079 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:42.723699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46249 (local address 127.0.0.1:45384)
0811 02:32:42.723898 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.723913 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.723994 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.724193 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.724194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.724196 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 02:32:42.724270 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:42.724273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.725012 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.725013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:42.725995 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:42.725999 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.726463 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.726464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:42.726534 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:42.726559 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 02:32:42.747245 (+ 20686us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 02:32:42.747376 (+ 131us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.79.62:46249: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260811 02:32:42.748090 27069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.723800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45384 (local address 127.17.79.62:46249)
0811 02:32:42.723850 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.723852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.723984 (+ 132us) server_negotiation.cc:407] Connection header received
0811 02:32:42.724090 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.724091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.724101 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.724160 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0811 02:32:42.724373 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.724923 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.726100 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.726367 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.726425 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:42.726680 (+ 255us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 02:32:42.746989 (+ 20309us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 02:32:42.747975 (+ 986us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 02:32:42.748155 27069 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45384: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.79.62:46249: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43183/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 02:32:42.748406 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 26905
2026-08-11T02:32:42Z chronyd exiting
I20260811 02:32:42.795500 17724 test_util.cc:175] -----------------------------------------------
I20260811 02:32:42.795598 17724 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786415535404356-17724-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (258 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 02:32:42.796478 17724 mini_oidc.cc:152] Starting JWKS server
I20260811 02:32:42.797209 17724 webserver.cc:460] Webserver started at https://127.0.0.1:39877/ using document root <none> and password file <none>
I20260811 02:32:42.797279 17724 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 02:32:42.797461 17724 webserver.cc:460] Webserver started at http://127.0.0.1:44533/ using document root <none> and password file <none>
2026-08-11T02:32:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:42Z Disabled control of system clock
I20260811 02:32:42.806262 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44195
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:40307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:44195
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39877/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/testchainca.cert with env {}
W20260811 02:32:42.887177 27093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:42.887434 27093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:42.887471 27093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:42.888656 27093 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:42.888722 27093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:42.888746 27093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:42.888767 27093 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:42.888796 27093 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 02:32:42.888819 27093 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 02:32:42.888849 27093 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39877/jwks.json
I20260811 02:32:42.890537 27093 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:40307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:44195
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39877/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:42.890820 27093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:42.891042 27093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:42.896041 27106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:42.896096 27102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:42.896061 27104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:42.896108 27093 server_base.cc:1034] running on GCE node
I20260811 02:32:42.896627 27093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:42.896893 27093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:42.898087 27093 hybrid_clock.cc:648] HybridClock initialized: now 1786415562898072 us; error 31 us; skew 500 ppm
I20260811 02:32:42.902463 27093 webserver.cc:460] Webserver started at http://127.17.79.62:35427/ using document root <none> and password file <none>
I20260811 02:32:42.902734 27093 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:42.902783 27093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:42.902941 27093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:42.903998 27093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "cfdae2b4c979460eb94635b247a52a9a"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "022174611026ee0a71cbc41fd68b055e"
server_key_iv: "d8e7086986adfa7571dd5c264c073709"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.904366 27093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "cfdae2b4c979460eb94635b247a52a9a"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "022174611026ee0a71cbc41fd68b055e"
server_key_iv: "d8e7086986adfa7571dd5c264c073709"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.905723 27093 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:42.906561 27112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:42.906780 27093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:42.906881 27093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "cfdae2b4c979460eb94635b247a52a9a"
format_stamp: "Formatted at 2026-08-11 02:32:42 on dist-test-slave-7nm7"
server_key: "022174611026ee0a71cbc41fd68b055e"
server_key_iv: "d8e7086986adfa7571dd5c264c073709"
server_key_version: "encryptionkey@0"
I20260811 02:32:42.906955 27093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:42.936775 27093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:42.937125 27093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:42.937280 27093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:42.941449 27093 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:44195
I20260811 02:32:42.941489 27203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:44195 every 8 connection(s)
I20260811 02:32:42.941831 27093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:42.942601 27205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:42.945369 27205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a: Bootstrap starting.
I20260811 02:32:42.945904 27205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:42.946143 27205 log.cc:824] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:42.946875 27205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a: No bootstrap required, opened a new log
I20260811 02:32:42.948429 27205 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfdae2b4c979460eb94635b247a52a9a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44195 } }
I20260811 02:32:42.948567 27205 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:42.948589 27205 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfdae2b4c979460eb94635b247a52a9a, State: Initialized, Role: FOLLOWER
I20260811 02:32:42.948730 27205 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfdae2b4c979460eb94635b247a52a9a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44195 } }
I20260811 02:32:42.948812 27205 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:42.948835 27205 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:42.948863 27205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:42.949359 27205 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfdae2b4c979460eb94635b247a52a9a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44195 } }
I20260811 02:32:42.949442 27205 leader_election.cc:302] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfdae2b4c979460eb94635b247a52a9a; no voters:
I20260811 02:32:42.949563 27205 leader_election.cc:288] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:42.949637 27210 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:42.949815 27210 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [term 1 LEADER]: Becoming Leader. State: Replica: cfdae2b4c979460eb94635b247a52a9a, State: Running, Role: LEADER
I20260811 02:32:42.949853 27205 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:42.949945 27210 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfdae2b4c979460eb94635b247a52a9a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44195 } }
I20260811 02:32:42.950340 27211 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfdae2b4c979460eb94635b247a52a9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfdae2b4c979460eb94635b247a52a9a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44195 } } }
I20260811 02:32:42.950435 27211 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:42.950532 27212 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfdae2b4c979460eb94635b247a52a9a. Latest consensus state: current_term: 1 leader_uuid: "cfdae2b4c979460eb94635b247a52a9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfdae2b4c979460eb94635b247a52a9a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44195 } } }
I20260811 02:32:42.950593 27212 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:42.950673 27224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:42.951208 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 27093
I20260811 02:32:42.951300 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:42.951464 17724 external_mini_cluster.cc:1428] Setting key 280b5e4b3a0cc4205be1ee35fca12f74
I20260811 02:32:42.951790 27224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:42.953377 27224 catalog_manager.cc:1347] Generated new cluster ID: f536dea631614cc88cbe44253e2fbc32
I20260811 02:32:42.953434 27224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:42.957690 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.951926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.17.79.62:44195)
0811 02:32:42.952313 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.952322 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.952356 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:32:42.952469 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.952478 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.952554 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.952741 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:42.953075 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.954465 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.955568 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.956162 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.956279 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:42.957003 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:42.957007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:42.957007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:42.957211 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:42.957253 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:42.957266 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:42.957326 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:42.957411 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 02:32:42.957480 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":65,"threads_started":1}
I20260811 02:32:42.958653 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:32:42.962296 27224 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:42.963004 27224 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:42.967592 27224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfdae2b4c979460eb94635b247a52a9a: Generated new TSK 0
I20260811 02:32:42.967772 27224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:32:42.996845 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:42.974548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50766 (local address 127.17.79.62:44195)
0811 02:32:42.974611 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:42.974614 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:42.974714 (+ 100us) server_negotiation.cc:407] Connection header received
0811 02:32:42.974806 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:42.974807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:42.974821 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:42.974906 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0811 02:32:42.975064 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.975586 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.976372 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.976595 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.976674 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:42.976865 (+ 191us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 02:32:42.996590 (+ 19725us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39877/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 02:32:42.996761 (+ 171us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50766: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39877/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 02:32:42.996920 27233 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50766: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39877/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
E20260811 02:32:42.997141 27254 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 02:32:42.997216 27254 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260811 02:32:42.997298 27251 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:42.974486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44195 (local address 127.0.0.1:50766)
0811 02:32:42.974643 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:42.974653 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:42.974733 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:42.974905 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:42.974906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:42.974908 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 02:32:42.974966 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:42.974968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.975691 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.975692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:42.976282 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:42.976284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:42.976676 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:42.976677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:42.976736 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:42.976741 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 02:32:42.996720 (+ 19979us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39877/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 02:32:42.996900 (+ 180us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.79.62:44195: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39877/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260811 02:32:42.997586 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 27093
2026-08-11T02:32:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (266 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 02:32:43.063392 17724 mini_oidc.cc:152] Starting JWKS server
I20260811 02:32:43.064342 17724 webserver.cc:460] Webserver started at https://127.0.0.1:44675/ using document root <none> and password file <none>
I20260811 02:32:43.064410 17724 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 02:32:43.064567 17724 webserver.cc:460] Webserver started at http://127.0.0.1:46609/ using document root <none> and password file <none>
2026-08-11T02:32:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:43Z Disabled control of system clock
I20260811 02:32:43.073786 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:40803
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:43561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:40803
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44675/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 02:32:43.155030 27261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:43.155256 27261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:43.155277 27261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:43.156446 27261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:43.156488 27261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:43.156502 27261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:43.156514 27261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:43.156526 27261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 02:32:43.156581 27261 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 02:32:43.156598 27261 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44675/jwks.json
I20260811 02:32:43.157991 27261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:40803
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:40803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44675/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:43.158278 27261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:43.158573 27261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:43.163482 27276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:43.163475 27278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:43.163589 27261 server_base.cc:1034] running on GCE node
W20260811 02:32:43.163476 27274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:43.163952 27261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:43.164314 27261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:43.165458 27261 hybrid_clock.cc:648] HybridClock initialized: now 1786415563165448 us; error 27 us; skew 500 ppm
I20260811 02:32:43.166828 27261 webserver.cc:460] Webserver started at http://127.17.79.62:43129/ using document root <none> and password file <none>
I20260811 02:32:43.167088 27261 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:43.167160 27261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:43.167321 27261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:43.168459 27261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "b86529d069b04af7ba1f01458c50f136"
format_stamp: "Formatted at 2026-08-11 02:32:43 on dist-test-slave-7nm7"
server_key: "ff761195b6c64bfbedae71dec553e13c"
server_key_iv: "6d8aaf4dbd87dbab107dc3f4fbe52796"
server_key_version: "encryptionkey@0"
I20260811 02:32:43.168828 27261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "b86529d069b04af7ba1f01458c50f136"
format_stamp: "Formatted at 2026-08-11 02:32:43 on dist-test-slave-7nm7"
server_key: "ff761195b6c64bfbedae71dec553e13c"
server_key_iv: "6d8aaf4dbd87dbab107dc3f4fbe52796"
server_key_version: "encryptionkey@0"
I20260811 02:32:43.170279 27261 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 02:32:43.171051 27285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:43.171265 27261 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:43.171387 27261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "b86529d069b04af7ba1f01458c50f136"
format_stamp: "Formatted at 2026-08-11 02:32:43 on dist-test-slave-7nm7"
server_key: "ff761195b6c64bfbedae71dec553e13c"
server_key_iv: "6d8aaf4dbd87dbab107dc3f4fbe52796"
server_key_version: "encryptionkey@0"
I20260811 02:32:43.171475 27261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:43.181658 27261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:43.181978 27261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:43.182140 27261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:43.186409 27261 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:40803
I20260811 02:32:43.186467 27369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:40803 every 8 connection(s)
I20260811 02:32:43.186828 27261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:43.187590 27370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:43.188181 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 27261
I20260811 02:32:43.188263 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:43.188446 17724 external_mini_cluster.cc:1428] Setting key d55c3bbf9cec61d1c7845bf4ef79cb16
I20260811 02:32:43.191607 27370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136: Bootstrap starting.
I20260811 02:32:43.192227 27370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:43.192526 27370 log.cc:824] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:43.193246 27370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136: No bootstrap required, opened a new log
I20260811 02:32:43.194406 27374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:43.188972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56590 (local address 127.17.79.62:40803)
0811 02:32:43.189194 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:43.189202 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:43.189236 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:32:43.189716 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:43.189725 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:43.189806 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:43.189958 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:43.190159 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.191543 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.192342 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.192808 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.192958 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:43.193684 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:43.193689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:43.193689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:43.193848 (+ 159us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:43.193884 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:43.193894 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:43.193953 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:43.194063 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 02:32:43.194153 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260811 02:32:43.195482 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:32:43.195694 27370 raft_consensus.cc:348] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86529d069b04af7ba1f01458c50f136" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40803 } }
I20260811 02:32:43.195842 27370 raft_consensus.cc:374] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:43.195888 27370 raft_consensus.cc:729] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b86529d069b04af7ba1f01458c50f136, State: Initialized, Role: FOLLOWER
I20260811 02:32:43.196012 27370 consensus_queue.cc:260] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86529d069b04af7ba1f01458c50f136" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40803 } }
I20260811 02:32:43.196090 27370 raft_consensus.cc:388] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:43.196131 27370 raft_consensus.cc:482] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:43.196179 27370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:43.196798 27370 raft_consensus.cc:504] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86529d069b04af7ba1f01458c50f136" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40803 } }
I20260811 02:32:43.196918 27370 leader_election.cc:302] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b86529d069b04af7ba1f01458c50f136; no voters:
I20260811 02:32:43.197084 27370 leader_election.cc:288] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:43.197131 27377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:43.197300 27377 raft_consensus.cc:686] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [term 1 LEADER]: Becoming Leader. State: Replica: b86529d069b04af7ba1f01458c50f136, State: Running, Role: LEADER
I20260811 02:32:43.197335 27370 sys_catalog.cc:564] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:43.197388 27377 consensus_queue.cc:237] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86529d069b04af7ba1f01458c50f136" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40803 } }
I20260811 02:32:43.197760 27379 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b86529d069b04af7ba1f01458c50f136. Latest consensus state: current_term: 1 leader_uuid: "b86529d069b04af7ba1f01458c50f136" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86529d069b04af7ba1f01458c50f136" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40803 } } }
I20260811 02:32:43.197767 27378 sys_catalog.cc:455] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b86529d069b04af7ba1f01458c50f136" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b86529d069b04af7ba1f01458c50f136" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40803 } } }
I20260811 02:32:43.197901 27379 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:43.197932 27378 sys_catalog.cc:458] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:43.198365 27388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:43.198884 27388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:43.200299 27388 catalog_manager.cc:1347] Generated new cluster ID: 88c6704db4d44d4783a6475ab90e86e2
I20260811 02:32:43.200356 27388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:43.238780 27388 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:43.239526 27388 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:43.245048 27388 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b86529d069b04af7ba1f01458c50f136: Generated new TSK 0
I20260811 02:32:43.245235 27388 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:32:43.256584 27374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:43.252793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56600 (local address 127.17.79.62:40803)
0811 02:32:43.252845 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:43.252847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:43.252967 (+ 120us) server_negotiation.cc:407] Connection header received
0811 02:32:43.253043 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:43.253044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:43.253055 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:43.253118 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0811 02:32:43.253272 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.253758 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.254974 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.255218 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.255297 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:43.255511 (+ 214us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 02:32:43.256357 (+ 846us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44675/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 02:32:43.256513 (+ 156us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56600: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44675/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 02:32:43.256649 27421 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:43.252698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:40803 (local address 127.0.0.1:56600)
0811 02:32:43.252875 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:43.252887 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:43.252966 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:43.253139 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:43.253140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:43.253142 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 02:32:43.253209 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:43.253211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.253855 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.253857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:43.254853 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:43.254857 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.255317 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.255318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:43.255378 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:43.255384 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 02:32:43.256463 (+ 1079us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44675/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 02:32:43.256554 (+ 91us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.79.62:40803: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44675/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":109,"threads_started":1}
W20260811 02:32:43.256657 27374 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56600: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44675/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260811 02:32:43.257076 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 27261
E20260811 02:32:43.269095 27422 webserver.cc:533] Webserver: sslize failed:
E20260811 02:32:43.269392 27422 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T02:32:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (244 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T02:32:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:43Z Disabled control of system clock
I20260811 02:32:43.316252 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45899
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:37865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45899
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/testchainca.cert with env {}
W20260811 02:32:43.399799 27427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:43.400004 27427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:43.400027 27427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:43.401194 27427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:43.401237 27427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:43.401249 27427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:43.401262 27427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:43.401274 27427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 02:32:43.401330 27427 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 02:32:43.401347 27427 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 02:32:43.402922 27427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:43.403190 27427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:43.403419 27427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:32:43.408564 27427 server_base.cc:1034] running on GCE node
W20260811 02:32:43.408521 27445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:43.408535 27443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:43.408521 27447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:43.408959 27427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:43.409219 27427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:43.410401 27427 hybrid_clock.cc:648] HybridClock initialized: now 1786415563410387 us; error 33 us; skew 500 ppm
I20260811 02:32:43.411651 27427 webserver.cc:460] Webserver started at http://127.17.79.62:46295/ using document root <none> and password file <none>
I20260811 02:32:43.411926 27427 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:43.411971 27427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:43.412143 27427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:43.413228 27427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "e5a0444f7c404bfa89bcdb6b4c778615"
format_stamp: "Formatted at 2026-08-11 02:32:43 on dist-test-slave-7nm7"
server_key: "33a9dcda0c783bec2e7e4fc6be192715"
server_key_iv: "87e6b878b35a5dbc287f66a5c12c50a3"
server_key_version: "encryptionkey@0"
I20260811 02:32:43.413595 27427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "e5a0444f7c404bfa89bcdb6b4c778615"
format_stamp: "Formatted at 2026-08-11 02:32:43 on dist-test-slave-7nm7"
server_key: "33a9dcda0c783bec2e7e4fc6be192715"
server_key_iv: "87e6b878b35a5dbc287f66a5c12c50a3"
server_key_version: "encryptionkey@0"
I20260811 02:32:43.415002 27427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:43.415752 27455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:43.415915 27427 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:43.416013 27427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "e5a0444f7c404bfa89bcdb6b4c778615"
format_stamp: "Formatted at 2026-08-11 02:32:43 on dist-test-slave-7nm7"
server_key: "33a9dcda0c783bec2e7e4fc6be192715"
server_key_iv: "87e6b878b35a5dbc287f66a5c12c50a3"
server_key_version: "encryptionkey@0"
I20260811 02:32:43.416075 27427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:43.426014 27427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:43.426360 27427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:43.426474 27427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:43.430485 27427 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:45899
I20260811 02:32:43.430564 27534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:45899 every 8 connection(s)
I20260811 02:32:43.430943 27427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:43.431941 27537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:43.434291 27537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615: Bootstrap starting.
I20260811 02:32:43.434896 27537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:43.435190 27537 log.cc:824] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:43.435899 27537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615: No bootstrap required, opened a new log
I20260811 02:32:43.437491 27537 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45899 } }
I20260811 02:32:43.437654 27537 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:43.437732 27537 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5a0444f7c404bfa89bcdb6b4c778615, State: Initialized, Role: FOLLOWER
I20260811 02:32:43.437899 27537 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45899 } }
I20260811 02:32:43.437983 27537 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:43.438025 27537 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:43.438073 27537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:43.438743 27537 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45899 } }
I20260811 02:32:43.438865 27537 leader_election.cc:302] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5a0444f7c404bfa89bcdb6b4c778615; no voters:
I20260811 02:32:43.439056 27537 leader_election.cc:288] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:43.439090 27541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:43.439270 27541 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [term 1 LEADER]: Becoming Leader. State: Replica: e5a0444f7c404bfa89bcdb6b4c778615, State: Running, Role: LEADER
I20260811 02:32:43.439317 27537 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:43.439370 27541 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45899 } }
I20260811 02:32:43.439759 27542 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45899 } } }
I20260811 02:32:43.439865 27543 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5a0444f7c404bfa89bcdb6b4c778615. Latest consensus state: current_term: 1 leader_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5a0444f7c404bfa89bcdb6b4c778615" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45899 } } }
I20260811 02:32:43.439926 27543 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:43.439890 27542 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:43.440459 27562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:43.440877 27562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:43.441128 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 27427
I20260811 02:32:43.441241 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:43.441435 17724 external_mini_cluster.cc:1428] Setting key 1983f6f0265211c6045465ec94330d3f
I20260811 02:32:43.442636 27562 catalog_manager.cc:1347] Generated new cluster ID: 5586907a88f348f7b514add0ea9ac939
I20260811 02:32:43.442692 27562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:43.451830 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:43.441881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.17.79.62:45899)
0811 02:32:43.442143 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:43.442152 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:43.442197 (+ 45us) server_negotiation.cc:407] Connection header received
0811 02:32:43.442337 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:43.442351 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:43.442415 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:43.446335 (+ 3920us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:43.446463 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.448372 (+ 1909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.449568 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.450165 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.450321 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:43.451086 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:43.451090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:43.451090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:32:43.451302 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:43.451342 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:32:43.451356 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:43.451419 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:43.451511 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 02:32:43.451585 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":83,"threads_started":1}
I20260811 02:32:43.452755 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:32:43.468710 27562 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:43.469444 27562 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:43.472551 27562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5a0444f7c404bfa89bcdb6b4c778615: Generated new TSK 0
I20260811 02:32:43.472735 27562 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:32:43.521793 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:43.483294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40930 (local address 127.17.79.62:45899)
0811 02:32:43.483364 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:43.483366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:43.483394 (+ 28us) server_negotiation.cc:407] Connection header received
0811 02:32:43.483477 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:43.483478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:43.483492 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:43.483572 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0811 02:32:43.483741 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.484508 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.485320 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.485637 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.485720 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:43.485882 (+ 162us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 02:32:43.521471 (+ 35589us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 02:32:43.521708 (+ 237us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40930: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 02:32:43.521885 27574 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40930: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 02:32:43.521886 27586 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:43.483166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45899 (local address 127.0.0.1:40930)
0811 02:32:43.483329 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:43.483341 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:43.483405 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:43.483605 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:43.483606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:43.483608 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 02:32:43.483662 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:43.483664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.484620 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.484621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:43.485230 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:43.485231 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:43.485732 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:43.485733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:43.485775 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:43.485780 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 02:32:43.521650 (+ 35870us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 02:32:43.521774 (+ 124us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.79.62:45899: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260811 02:32:43.523172 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 27427
2026-08-11T02:32:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (241 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (89 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:43 dist-test-slave-7nm7 krb5kdc[27606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:43 dist-test-slave-7nm7 krb5kdc[27606](info): set up 2 sockets
Aug 11 02:32:43 dist-test-slave-7nm7 krb5kdc[27606](info): commencing operation
krb5kdc: starting...
W20260811 02:32:45.019251 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:45.148574 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35399
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:35399
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:45.234534 27634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:45.234740 27634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:45.234763 27634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:45.235863 27634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:45.235898 27634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:45.235913 27634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:45.235925 27634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:45.235937 27634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:45.237583 27634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:35399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:45.237802 27634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:45.237982 27634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:45.243355 27640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:45.243381 27639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:45.243453 27634 server_base.cc:1034] running on GCE node
W20260811 02:32:45.243355 27642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:45.243788 27634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:45.244129 27634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:45.245352 27634 hybrid_clock.cc:648] HybridClock initialized: now 1786415565245342 us; error 38 us; skew 500 ppm
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.249082 27634 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:45.249647 27634 webserver.cc:460] Webserver started at http://127.17.79.62:36795/ using document root <none> and password file <none>
I20260811 02:32:45.249899 27634 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:45.249977 27634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:45.250136 27634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:45.251292 27634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "74fd0e7df4cb497d8f0337e582aa3b26"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "c2dee065b0efd044dcc0e93e20d67934"
server_key_iv: "b234c2a2711f97734901fb5c735330e3"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.251679 27634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "74fd0e7df4cb497d8f0337e582aa3b26"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "c2dee065b0efd044dcc0e93e20d67934"
server_key_iv: "b234c2a2711f97734901fb5c735330e3"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.253077 27634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:45.253999 27655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.254375 27634 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:45.254521 27634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "74fd0e7df4cb497d8f0337e582aa3b26"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "c2dee065b0efd044dcc0e93e20d67934"
server_key_iv: "b234c2a2711f97734901fb5c735330e3"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.254624 27634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:45.268002 27634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:45.270476 27634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:45.270656 27634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:45.275215 27634 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:35399
I20260811 02:32:45.275250 27742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:35399 every 8 connection(s)
I20260811 02:32:45.275624 27634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:45.276511 27744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:45.278903 27744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26: Bootstrap starting.
I20260811 02:32:45.279512 27744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:45.279827 27744 log.cc:824] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:45.280686 27744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26: No bootstrap required, opened a new log
I20260811 02:32:45.282414 27744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35399 } }
I20260811 02:32:45.282560 27744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:45.282585 27744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74fd0e7df4cb497d8f0337e582aa3b26, State: Initialized, Role: FOLLOWER
I20260811 02:32:45.282738 27744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35399 } }
I20260811 02:32:45.282797 27744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:45.282840 27744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:45.282891 27744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:45.283419 27744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35399 } }
I20260811 02:32:45.283504 27744 leader_election.cc:302] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74fd0e7df4cb497d8f0337e582aa3b26; no voters:
I20260811 02:32:45.283722 27744 leader_election.cc:288] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:45.283874 27747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:45.283927 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 27634
I20260811 02:32:45.284004 27744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:45.284026 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:45.284265 17724 external_mini_cluster.cc:1428] Setting key e8f4ca4f9ac5fa6ef6eac3140afc531e
I20260811 02:32:45.284327 27747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [term 1 LEADER]: Becoming Leader. State: Replica: 74fd0e7df4cb497d8f0337e582aa3b26, State: Running, Role: LEADER
I20260811 02:32:45.284437 27747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35399 } }
I20260811 02:32:45.284818 27748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35399 } } }
I20260811 02:32:45.284910 27748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:45.285166 27749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74fd0e7df4cb497d8f0337e582aa3b26. Latest consensus state: current_term: 1 leader_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd0e7df4cb497d8f0337e582aa3b26" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35399 } } }
I20260811 02:32:45.285246 27749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26 [sys.catalog]: This master's current role is: LEADER
W20260811 02:32:45.285930 27774 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:45.285995 27774 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:45.286046 27776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:45.286201 27776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:45.287811 27776 catalog_manager.cc:1347] Generated new cluster ID: e292fb659efd46219415275ce974ddf6
I20260811 02:32:45.287869 27776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:45.295756 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.285378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33058 (local address 127.17.79.62:35399)
0811 02:32:45.285696 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.285706 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.285742 (+ 36us) server_negotiation.cc:407] Connection header received
0811 02:32:45.285859 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.285866 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.285926 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.286833 (+ 907us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.286939 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.288200 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.288978 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.289408 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.289535 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.291923 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:45.291927 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:45.291928 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:45.291940 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:45.293946 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.294535 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.294538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.294539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.294636 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.294877 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.294878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.294878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.295129 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:45.295316 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:45.295396 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 02:32:45.295540 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":64,"threads_started":1}
I20260811 02:32:45.310138 27776 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:45.310704 27776 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:45.316336 27776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74fd0e7df4cb497d8f0337e582aa3b26: Generated new TSK 0
I20260811 02:32:45.316527 27776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:45.349193 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35399
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:45.443626 27785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:45.443846 27785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:45.443871 27785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:45.445170 27785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:45.445220 27785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:45.445248 27785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:45.446996 27785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:45.447258 27785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:45.447497 27785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:45.452767 27800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:45.452757 27795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:45.452891 27785 server_base.cc:1034] running on GCE node
W20260811 02:32:45.452819 27791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:45.453245 27785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:45.453518 27785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:45.454689 27785 hybrid_clock.cc:648] HybridClock initialized: now 1786415565454665 us; error 39 us; skew 500 ppm
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.457707 27785 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:45.458387 27785 webserver.cc:460] Webserver started at http://127.17.79.1:44133/ using document root <none> and password file <none>
I20260811 02:32:45.458650 27785 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:45.458729 27785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:45.458871 27785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:45.459939 27785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "e04eeea711234b2fbe2fbf2bc6793f13"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "1f2b891b0fee7df72a1be80060a8f5b3"
server_key_iv: "8b336d142f332502cd444fde1a46e471"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.460316 27785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "e04eeea711234b2fbe2fbf2bc6793f13"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "1f2b891b0fee7df72a1be80060a8f5b3"
server_key_iv: "8b336d142f332502cd444fde1a46e471"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.462093 27785 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 02:32:45.462908 27811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.463128 27785 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:45.463231 27785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "e04eeea711234b2fbe2fbf2bc6793f13"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "1f2b891b0fee7df72a1be80060a8f5b3"
server_key_iv: "8b336d142f332502cd444fde1a46e471"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.463325 27785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:45.482708 27785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:45.485917 27785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:45.486104 27785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:45.486440 27785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:45.486819 27785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:45.486881 27785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.486924 27785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:45.486950 27785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.493249 27785 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:41449
I20260811 02:32:45.493309 28007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:41449 every 8 connection(s)
I20260811 02:32:45.493816 27785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:45.495720 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 27785
I20260811 02:32:45.495857 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:45.496136 17724 external_mini_cluster.cc:1428] Setting key 3501a33125c457dd0031c22a4a82df99
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:45.505561 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.494703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:44297 (local address 127.17.79.62:35399)
0811 02:32:45.494784 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.494786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.494991 (+ 205us) server_negotiation.cc:407] Connection header received
0811 02:32:45.496038 (+ 1047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.496039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.496053 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.496138 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.497126 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.497883 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.499082 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.499300 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.499380 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.502537 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:45.502539 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:45.502539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:45.502557 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:45.504081 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.504525 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.504526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.504526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.504589 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.504880 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.504881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.504882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.505002 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:45.505076 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:45.505378 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 02:32:45.505468 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 02:32:45.505762 28012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.494644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35399 (local address 127.17.79.1:44297)
0811 02:32:45.494850 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:45.494895 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:45.495911 (+ 1016us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:45.496354 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:45.496360 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:45.496747 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:45.497016 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:45.497022 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.498000 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.498001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:45.498974 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:45.498977 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.499389 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.499390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:45.499514 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.500581 (+ 1067us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:45.500590 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:45.502425 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:45.504192 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:45.504201 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:45.504203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:45.504441 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:45.504670 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:45.504671 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:45.504671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:45.504802 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:45.505079 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:45.505087 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:45.505236 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 02:32:45.505342 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 02:32:45.505510 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":120,"threads_started":1}
I20260811 02:32:45.506419 28009 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35399
I20260811 02:32:45.506510 28009 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:45.506712 28009 heartbeater.cc:511] Master 127.17.79.62:35399 requested a full tablet report, sending...
I20260811 02:32:45.507342 27688 ts_manager.cc:194] Registered new tserver with Master: e04eeea711234b2fbe2fbf2bc6793f13 (127.17.79.1:41449)
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
I20260811 02:32:45.507952 27688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:44297
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:45.527143 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35399
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:45.611747 28020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:45.612004 28020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:45.612042 28020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:45.613179 28020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:45.613243 28020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:45.613287 28020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:45.614816 28020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:45.615082 28020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:45.615314 28020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:45.620535 28027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:45.620645 28030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:45.620544 28028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:45.620682 28020 server_base.cc:1034] running on GCE node
I20260811 02:32:45.620905 28020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:45.621158 28020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:45.622321 28020 hybrid_clock.cc:648] HybridClock initialized: now 1786415565622299 us; error 37 us; skew 500 ppm
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.624965 28020 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:45.625451 28020 webserver.cc:460] Webserver started at http://127.17.79.2:36507/ using document root <none> and password file <none>
I20260811 02:32:45.625711 28020 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:45.625783 28020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:45.625936 28020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:45.627092 28020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "0873023369104037b8ce85f1ae075a3b"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "e84dce113d912ab25ad8e76ba87f67d5"
server_key_iv: "88623b3774b425640b35676068b85d2e"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.627455 28020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "0873023369104037b8ce85f1ae075a3b"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "e84dce113d912ab25ad8e76ba87f67d5"
server_key_iv: "88623b3774b425640b35676068b85d2e"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.628859 28020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:32:45.629706 28043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.629902 28020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:45.630000 28020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "0873023369104037b8ce85f1ae075a3b"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "e84dce113d912ab25ad8e76ba87f67d5"
server_key_iv: "88623b3774b425640b35676068b85d2e"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.630084 28020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:45.638674 28020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:45.641095 28020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:45.641276 28020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:45.641520 28020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:45.641834 28020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:45.641889 28020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.641929 28020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:45.641957 28020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.648440 28020 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:45851
I20260811 02:32:45.648485 28232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:45851 every 8 connection(s)
I20260811 02:32:45.648820 28020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:45.653139 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 28020
I20260811 02:32:45.653259 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:45.653467 17724 external_mini_cluster.cc:1428] Setting key c267e43b17bb009870f2cd4182554dff
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:45.659495 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.649712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:45625 (local address 127.17.79.62:35399)
0811 02:32:45.649780 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.649782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.649918 (+ 136us) server_negotiation.cc:407] Connection header received
0811 02:32:45.650962 (+ 1044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.650963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.650974 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.651046 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.651664 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.652186 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.653401 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.653639 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.653733 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.656366 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:45.656368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:45.656368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:45.656376 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:45.657918 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.658420 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.658421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.658422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.658485 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.658825 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.658826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.658826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.658948 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:45.659028 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:45.659316 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 02:32:45.659406 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 02:32:45.659690 28237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.649624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35399 (local address 127.17.79.2:45625)
0811 02:32:45.649787 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:45.649831 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:45.650842 (+ 1011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:45.651132 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:45.651135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:45.651388 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:45.651578 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:45.651582 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.652281 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.652282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:45.653293 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:45.653296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.653749 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.653750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:45.653920 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.654609 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:45.654618 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:45.656248 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:45.658015 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:45.658022 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:45.658024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:45.658326 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:45.658564 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:45.658565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:45.658565 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:45.658735 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:45.659020 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:45.659026 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:45.659175 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 02:32:45.659282 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 02:32:45.659446 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260811 02:32:45.660370 28234 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35399
I20260811 02:32:45.660456 28234 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:45.660657 28234 heartbeater.cc:511] Master 127.17.79.62:35399 requested a full tablet report, sending...
I20260811 02:32:45.661084 27688 ts_manager.cc:194] Registered new tserver with Master: 0873023369104037b8ce85f1ae075a3b (127.17.79.2:45851)
I20260811 02:32:45.661471 27688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:45625
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:45.680758 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35399
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:45.762619 28240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:45.762873 28240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:45.762916 28240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:45.764075 28240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:45.764147 28240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:45.764194 28240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:45.766193 28240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:45.766467 28240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:45.766717 28240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:45.772039 28251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:45.771922 28248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:45.771939 28240 server_base.cc:1034] running on GCE node
W20260811 02:32:45.771939 28247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:45.772456 28240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:45.772725 28240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:45.773902 28240 hybrid_clock.cc:648] HybridClock initialized: now 1786415565773897 us; error 36 us; skew 500 ppm
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.776692 28240 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:45.777217 28240 webserver.cc:460] Webserver started at http://127.17.79.3:44661/ using document root <none> and password file <none>
I20260811 02:32:45.777457 28240 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:45.777527 28240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:45.777685 28240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:45.778843 28240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "922e119ce4fb4610ba8d70e114211e96"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "0a1ac0aa0c8198f4baa87b69ddeb5fce"
server_key_iv: "d24fea4edde26bcfb8d23aaa809953e2"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.779241 28240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "922e119ce4fb4610ba8d70e114211e96"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "0a1ac0aa0c8198f4baa87b69ddeb5fce"
server_key_iv: "d24fea4edde26bcfb8d23aaa809953e2"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.780644 28240 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:32:45.781493 28261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.781711 28240 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:45.781818 28240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "922e119ce4fb4610ba8d70e114211e96"
format_stamp: "Formatted at 2026-08-11 02:32:45 on dist-test-slave-7nm7"
server_key: "0a1ac0aa0c8198f4baa87b69ddeb5fce"
server_key_iv: "d24fea4edde26bcfb8d23aaa809953e2"
server_key_version: "encryptionkey@0"
I20260811 02:32:45.781896 28240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:45.791738 28240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:45.793687 28240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:45.793854 28240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:45.794097 28240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:45.794576 28240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:45.794656 28240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.794706 28240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:45.794749 28240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:45.800920 28240 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:44503
I20260811 02:32:45.800971 28441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:44503 every 8 connection(s)
I20260811 02:32:45.801290 28240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:45.806345 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 28240
I20260811 02:32:45.806463 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:45.806661 17724 external_mini_cluster.cc:1428] Setting key 2030ea8026abb2de90825143f7c175e4
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:45.811790 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.801996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:48561 (local address 127.17.79.62:35399)
0811 02:32:45.802065 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.802067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.802316 (+ 249us) server_negotiation.cc:407] Connection header received
0811 02:32:45.803273 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.803275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.803287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.803357 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.803963 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.804474 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.805460 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.805686 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.805757 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.808765 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:45.808767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:45.808767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:45.808775 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:45.810521 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.810910 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.810911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.810911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.810965 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.811201 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.811202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.811202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.811308 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:45.811362 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:45.811659 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 02:32:45.811725 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:32:45.811977 28447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.801969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35399 (local address 127.17.79.3:48561)
0811 02:32:45.802144 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:45.802196 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:45.803143 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:45.803411 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:45.803414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:45.803674 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:45.803865 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:45.803868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.804562 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.804563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:45.805366 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:45.805368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.805773 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.805774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:45.805872 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.806760 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:45.806772 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:45.808632 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:45.810600 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:45.810607 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:45.810608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:45.810841 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:45.811026 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:45.811027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:45.811027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:45.811143 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:45.811390 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:45.811396 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:45.811522 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 02:32:45.811632 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 02:32:45.811760 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260811 02:32:45.812561 28443 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35399
I20260811 02:32:45.812682 28443 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:45.812867 28443 heartbeater.cc:511] Master 127.17.79.62:35399 requested a full tablet report, sending...
I20260811 02:32:45.813342 27688 ts_manager.cc:194] Registered new tserver with Master: 922e119ce4fb4610ba8d70e114211e96 (127.17.79.3:44503)
I20260811 02:32:45.813730 27688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:48561
I20260811 02:32:45.818961 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/test-admin.keytab.
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.835384 17724 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 02:32:45.837173 28458 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:45.836370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56222 (local address 127.17.79.1:41449)
0811 02:32:45.836552 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.836556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.836567 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:45.836594 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.836596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.836610 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.836682 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.837083 (+ 401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56222: BlockingRecv error: recv got EOF from 127.0.0.1:56222 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
W20260811 02:32:45.837306 17724 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5cc' of type FILE
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.838581 17724 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.839608 17724 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:45.849145 28458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.840300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56232 (local address 127.17.79.1:41449)
0811 02:32:45.840362 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.840363 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.840433 (+ 70us) server_negotiation.cc:407] Connection header received
0811 02:32:45.840492 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.840493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.840503 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.840552 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.841001 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.841756 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.842688 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.843018 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.843081 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.845679 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:45.845698 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:45.845698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:45.845706 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:45.847675 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.848134 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.848138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.848139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.848215 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.848487 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.848489 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.848496 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.848659 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:45.848856 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:45.848917 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 02:32:45.849013 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 02:32:45.851167 28458 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:45.850640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.17.79.1:41449)
0811 02:32:45.850738 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.850740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.850751 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:45.850771 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.850772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.850783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.850832 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.851120 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56234: BlockingRecv error: recv got EOF from 127.0.0.1:56234 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 02:32:45.851367 17724 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5cc' of type FILE
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.852337 17724 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.853209 17724 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:45.860515 28458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.853714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56244 (local address 127.17.79.1:41449)
0811 02:32:45.853778 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.853781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.853829 (+ 48us) server_negotiation.cc:407] Connection header received
0811 02:32:45.853923 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.853924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.853940 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.854000 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.854417 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.854888 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.855556 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.855758 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.855835 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.857845 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:45.857846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:45.857847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:45.857854 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:45.859268 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.859632 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.859634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.859634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.859691 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.859893 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.859894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.859895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.859992 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:45.860191 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:45.860323 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 02:32:45.860414 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 02:32:45.862157 28458 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:45.861588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56246 (local address 127.17.79.1:41449)
0811 02:32:45.861636 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.861638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.861709 (+ 71us) server_negotiation.cc:407] Connection header received
0811 02:32:45.861780 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.861781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.861787 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.861835 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.862101 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56246: BlockingRecv error: recv got EOF from 127.0.0.1:56246 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 02:32:45.862373 17724 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786415535404356-17724-0/krb5kdc/krb5cc' of type FILE
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.863397 17724 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:45.864316 17724 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[27606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:32:45.871752 28458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:45.864805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56258 (local address 127.17.79.1:41449)
0811 02:32:45.864851 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:45.864853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:45.864882 (+ 29us) server_negotiation.cc:407] Connection header received
0811 02:32:45.864940 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:45.864941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:45.864948 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:45.864996 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:45.865402 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.865856 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.866737 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:45.866914 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:45.866968 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:45.869217 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:45.869219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:45.869219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:45.869226 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:45.870819 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.871166 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.871167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.871167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.871221 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:45.871393 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:45.871394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:45.871394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:45.871475 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:45.871554 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:45.871634 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 02:32:45.871694 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 02:32:45.872484 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 27785
I20260811 02:32:45.888407 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 28020
I20260811 02:32:45.898995 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 28240
I20260811 02:32:45.918084 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 27634
2026-08-11T02:32:45Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2207 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[28484](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[28484](info): set up 2 sockets
Aug 11 02:32:45 dist-test-slave-7nm7 krb5kdc[28484](info): commencing operation
krb5kdc: starting...
W20260811 02:32:47.215634 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:47Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab.
Entry for principal oryx/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab.
I20260811 02:32:47.336400 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:37437
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab
--principal=oryx/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:37437
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:47.418591 28506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:47.418795 28506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:47.418817 28506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:47.419914 28506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:47.419953 28506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:47.419967 28506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:47.419979 28506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:47.419991 28506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:47.421448 28506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:37437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab
--principal=oryx/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:37437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:47.421648 28506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:47.421815 28506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:47.426724 28514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:47.426775 28515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:47.426753 28506 server_base.cc:1034] running on GCE node
W20260811 02:32:47.426730 28519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:47.427127 28506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:47.427430 28506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:47.428561 28506 hybrid_clock.cc:648] HybridClock initialized: now 1786415567428545 us; error 43 us; skew 500 ppm
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:47.433799 28506 init.cc:377] Logged in from keytab as oryx/127.17.79.62@KRBTEST.COM (short username oryx)
I20260811 02:32:47.434410 28506 webserver.cc:460] Webserver started at http://127.17.79.62:42279/ using document root <none> and password file <none>
I20260811 02:32:47.434672 28506 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:47.434746 28506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:47.434876 28506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:47.436296 28506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "16679289171c43bebb7590e7bec4bff5"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "097b21598e976c15413199109eba0f07"
server_key_iv: "efda73eb6e87706e2fea27c6d268d6c4"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.436790 28506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "16679289171c43bebb7590e7bec4bff5"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "097b21598e976c15413199109eba0f07"
server_key_iv: "efda73eb6e87706e2fea27c6d268d6c4"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.438292 28506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 02:32:47.439220 28530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.439553 28506 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:47.439659 28506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "16679289171c43bebb7590e7bec4bff5"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "097b21598e976c15413199109eba0f07"
server_key_iv: "efda73eb6e87706e2fea27c6d268d6c4"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.439749 28506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:47.460057 28506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:47.462308 28506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:47.462481 28506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:47.466888 28506 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:37437
I20260811 02:32:47.466926 28623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:37437 every 8 connection(s)
I20260811 02:32:47.467320 28506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:47.468307 28624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:47.470614 28624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: Bootstrap starting.
I20260811 02:32:47.471225 28624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:47.471362 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 28506
I20260811 02:32:47.471495 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:47.471611 28624 log.cc:824] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:47.471729 17724 external_mini_cluster.cc:1428] Setting key 23510b73a4bd463f6b1bb33ab490252d
I20260811 02:32:47.472467 28624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: No bootstrap required, opened a new log
I20260811 02:32:47.475986 28624 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } }
I20260811 02:32:47.476306 28624 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:47.476367 28624 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16679289171c43bebb7590e7bec4bff5, State: Initialized, Role: FOLLOWER
I20260811 02:32:47.476504 28624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } }
I20260811 02:32:47.476624 28624 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:47.476668 28624 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:47.476717 28624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:47.477386 28624 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } }
I20260811 02:32:47.477512 28624 leader_election.cc:302] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16679289171c43bebb7590e7bec4bff5; no voters:
I20260811 02:32:47.477700 28624 leader_election.cc:288] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:47.477744 28630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:47.477905 28630 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 1 LEADER]: Becoming Leader. State: Replica: 16679289171c43bebb7590e7bec4bff5, State: Running, Role: LEADER
I20260811 02:32:47.477969 28624 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:47.478008 28630 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } }
I20260811 02:32:47.478547 28630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16679289171c43bebb7590e7bec4bff5. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } }
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:47.478636 28630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:47.478811 28635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } }
I20260811 02:32:47.478886 28635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:47.479290 28638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:47.479844 28638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:47.481678 28638 catalog_manager.cc:1347] Generated new cluster ID: 9bbf71544c0e4b1fa78eacc22cbb6831
I20260811 02:32:47.481734 28638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:47.482980 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:47.472215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45696 (local address 127.17.79.62:37437)
0811 02:32:47.472403 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:47.472413 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:47.472445 (+ 32us) server_negotiation.cc:407] Connection header received
0811 02:32:47.472942 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:47.472950 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:47.472996 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:47.473160 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:47.473793 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.474857 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.475647 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.476075 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.476199 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:47.479243 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:47.479247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:47.479248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:47.479261 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:47.481454 (+ 2193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:47.481873 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:47.481875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:47.481876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:47.481960 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:47.482196 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:47.482197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:47.482197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:47.482507 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:47.482625 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:47.482743 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 02:32:47.482842 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260811 02:32:47.489071 28638 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:47.489571 28638 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:47.493778 28638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: Generated new TSK 0
I20260811 02:32:47.493952 28638 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab.
Entry for principal oryx/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab.
I20260811 02:32:47.523407 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37437
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab
--principal=oryx/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:47.612291 28666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:47.612502 28666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:47.612526 28666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:47.613682 28666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:47.613729 28666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:47.613755 28666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:47.615278 28666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab
--principal=oryx/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:47.615522 28666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:47.615763 28666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:47.621047 28674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:47.621284 28676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:47.621083 28666 server_base.cc:1034] running on GCE node
W20260811 02:32:47.621054 28678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:47.621758 28666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:47.621966 28666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:47.623128 28666 hybrid_clock.cc:648] HybridClock initialized: now 1786415567623085 us; error 85 us; skew 500 ppm
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:47.625834 28666 init.cc:377] Logged in from keytab as oryx/127.17.79.1@KRBTEST.COM (short username oryx)
I20260811 02:32:47.626374 28666 webserver.cc:460] Webserver started at http://127.17.79.1:42077/ using document root <none> and password file <none>
I20260811 02:32:47.626638 28666 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:47.626689 28666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:47.626870 28666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:47.627962 28666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "9c4e7f4fd08f4532971f0894ce157ae1"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "75c788472d45aa57888852084f672729"
server_key_iv: "f9fc20eeb53b676b27177d433534f940"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.628353 28666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "9c4e7f4fd08f4532971f0894ce157ae1"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "75c788472d45aa57888852084f672729"
server_key_iv: "f9fc20eeb53b676b27177d433534f940"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.629786 28666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:47.630750 28689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.630930 28666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:47.631067 28666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "9c4e7f4fd08f4532971f0894ce157ae1"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "75c788472d45aa57888852084f672729"
server_key_iv: "f9fc20eeb53b676b27177d433534f940"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.631146 28666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:47.662012 28666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:47.664093 28666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:47.664274 28666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:47.664528 28666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:47.664876 28666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:47.664933 28666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.664975 28666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:47.665021 28666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.671362 28666 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:37027
I20260811 02:32:47.671428 28876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:37027 every 8 connection(s)
I20260811 02:32:47.671753 28666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:47.680893 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 28666
I20260811 02:32:47.681030 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:47.681073 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:47.672524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:48389 (local address 127.17.79.62:37437)
0811 02:32:47.672572 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:47.672574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:47.672763 (+ 189us) server_negotiation.cc:407] Connection header received
0811 02:32:47.673274 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:47.673275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:47.673285 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:47.673344 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:47.674314 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.674827 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.675773 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.675964 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.676020 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:47.678145 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:47.678147 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:47.678147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:47.678155 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:47.679543 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:47.679974 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:47.679976 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:47.679976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:47.680033 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:47.680377 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:47.680378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:47.680378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:47.680490 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:47.680547 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:47.680833 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 02:32:47.680945 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:47.681231 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:47.672480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:48389)
0811 02:32:47.672648 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:47.672692 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:47.673182 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:47.673419 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:47.673422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:47.673973 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:47.674186 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:47.674190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.674907 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.674908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:47.675693 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:47.675695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.676039 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.676040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:47.676148 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:47.676679 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:47.676688 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:47.678016 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:47.679625 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:47.679632 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:47.679634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:47.679902 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:47.680148 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:47.680149 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:47.680149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:47.680297 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:47.680555 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:47.680561 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:47.680669 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 02:32:47.680807 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 02:32:47.680986 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":109,"threads_started":1}
I20260811 02:32:47.681268 17724 external_mini_cluster.cc:1428] Setting key 5feda26d076f807da2a27822654d0d03
I20260811 02:32:47.681762 28878 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37437
I20260811 02:32:47.681874 28878 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:47.682050 28878 heartbeater.cc:511] Master 127.17.79.62:37437 requested a full tablet report, sending...
I20260811 02:32:47.682669 28556 ts_manager.cc:194] Registered new tserver with Master: 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027)
I20260811 02:32:47.683580 28556 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:48389
WARNING: no policy specified for oryx/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab.
Entry for principal oryx/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab.
I20260811 02:32:47.707108 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37437
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab
--principal=oryx/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:47.788440 28885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:47.788643 28885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:47.788668 28885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:47.789711 28885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:47.789744 28885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:47.789769 28885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:47.791215 28885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab
--principal=oryx/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:47.791417 28885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:47.791603 28885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:47.796551 28896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:47.796607 28893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:47.796581 28894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:47.796774 28885 server_base.cc:1034] running on GCE node
I20260811 02:32:47.796983 28885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:47.797236 28885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:47.798384 28885 hybrid_clock.cc:648] HybridClock initialized: now 1786415567798373 us; error 28 us; skew 500 ppm
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:47.800963 28885 init.cc:377] Logged in from keytab as oryx/127.17.79.2@KRBTEST.COM (short username oryx)
I20260811 02:32:47.801478 28885 webserver.cc:460] Webserver started at http://127.17.79.2:33121/ using document root <none> and password file <none>
I20260811 02:32:47.801779 28885 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:47.801853 28885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:47.802012 28885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:47.803105 28885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "aaea37fa8f5a479c92344445befbe98f"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "08d5caf32d59905f965d9e8d9465b221"
server_key_iv: "5fc0675acfa3c0c6c336877f309e40a5"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.803467 28885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "aaea37fa8f5a479c92344445befbe98f"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "08d5caf32d59905f965d9e8d9465b221"
server_key_iv: "5fc0675acfa3c0c6c336877f309e40a5"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.804831 28885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:32:47.805612 28908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.805799 28885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:47.805899 28885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "aaea37fa8f5a479c92344445befbe98f"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "08d5caf32d59905f965d9e8d9465b221"
server_key_iv: "5fc0675acfa3c0c6c336877f309e40a5"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.805986 28885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:47.817049 28885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:47.819437 28885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:47.819610 28885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:47.819855 28885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:47.820183 28885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:47.820238 28885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.820282 28885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:47.820312 28885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.826694 28885 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46177
I20260811 02:32:47.826741 29094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46177 every 8 connection(s)
I20260811 02:32:47.827093 28885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:47.831910 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 28885
I20260811 02:32:47.832036 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:47.832266 17724 external_mini_cluster.cc:1428] Setting key 22ffe0d90773ba75bc77b4a7be4f980b
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:47.837278 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:47.827940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:51617 (local address 127.17.79.62:37437)
0811 02:32:47.827993 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:47.827995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:47.828207 (+ 212us) server_negotiation.cc:407] Connection header received
0811 02:32:47.828680 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:47.828682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:47.828693 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:47.828777 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:47.829709 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.830350 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.831379 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.831568 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.831627 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:47.834079 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:47.834081 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:47.834081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:47.834089 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:47.835618 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:47.836174 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:47.836175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:47.836175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:47.836236 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:47.836562 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:47.836563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:47.836564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:47.836731 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:47.836806 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:47.837048 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 02:32:47.837142 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:32:47.837289 29098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:47.827894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:51617)
0811 02:32:47.828057 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:47.828101 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:47.828596 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:47.828825 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:47.828828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:47.829414 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:47.829618 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:47.829623 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.830466 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.830467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:47.831297 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:47.831299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:47.831647 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:47.831648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:47.831748 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:47.832344 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:47.832357 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:47.833991 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:47.835714 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:47.835722 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:47.835725 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:47.836074 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:47.836347 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:47.836348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:47.836348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:47.836490 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:47.836801 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:47.836806 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:47.836917 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 02:32:47.837001 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 02:32:47.837124 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260811 02:32:47.837998 29096 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37437
I20260811 02:32:47.838191 29096 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:47.838464 29096 heartbeater.cc:511] Master 127.17.79.62:37437 requested a full tablet report, sending...
I20260811 02:32:47.838972 28556 ts_manager.cc:194] Registered new tserver with Master: aaea37fa8f5a479c92344445befbe98f (127.17.79.2:46177)
I20260811 02:32:47.839375 28556 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:51617
WARNING: no policy specified for oryx/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab.
Entry for principal oryx/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab.
I20260811 02:32:47.860882 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37437
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab
--principal=oryx/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:47.945433 29105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:47.945715 29105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:47.945742 29105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:47.946919 29105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:47.946961 29105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:47.946992 29105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:47.948382 29105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab
--principal=oryx/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:37437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:47.948558 29105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:47.948730 29105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:47.954049 29117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:47.954080 29119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:47.954097 29116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:47.954104 29105 server_base.cc:1034] running on GCE node
I20260811 02:32:47.954613 29105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:47.954906 29105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:47.956080 29105 hybrid_clock.cc:648] HybridClock initialized: now 1786415567956053 us; error 35 us; skew 500 ppm
Aug 11 02:32:47 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:47.958782 29105 init.cc:377] Logged in from keytab as oryx/127.17.79.3@KRBTEST.COM (short username oryx)
I20260811 02:32:47.959266 29105 webserver.cc:460] Webserver started at http://127.17.79.3:33395/ using document root <none> and password file <none>
I20260811 02:32:47.959503 29105 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:47.959575 29105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:47.959735 29105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:47.960809 29105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "8192f9fdf5374c61b0dea22e91955b04"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "3962239aaa864d031983b409d2cd7e19"
server_key_iv: "19bddda3cc5a523e25b05de278fb7c08"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.961211 29105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "8192f9fdf5374c61b0dea22e91955b04"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "3962239aaa864d031983b409d2cd7e19"
server_key_iv: "19bddda3cc5a523e25b05de278fb7c08"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.962730 29105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:47.963683 29138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.963860 29105 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:47.963966 29105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "8192f9fdf5374c61b0dea22e91955b04"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "3962239aaa864d031983b409d2cd7e19"
server_key_iv: "19bddda3cc5a523e25b05de278fb7c08"
server_key_version: "encryptionkey@0"
I20260811 02:32:47.964040 29105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:47.996899 29105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:47.999045 29105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:47.999226 29105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:47.999464 29105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:47.999811 29105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:47.999866 29105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:47.999908 29105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:47.999936 29105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.005965 29105 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:37149
I20260811 02:32:48.006044 29328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:37149 every 8 connection(s)
I20260811 02:32:48.006421 29105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:48.006650 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 29105
I20260811 02:32:48.006752 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:48.006991 17724 external_mini_cluster.cc:1428] Setting key 134809b080ac672933a99e23f8e75433
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:48.017056 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.008701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:48983 (local address 127.17.79.62:37437)
0811 02:32:48.008757 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.008759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.008766 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:48.008789 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.008789 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.008799 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.008862 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.009972 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.010562 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.011554 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.011766 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.011844 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.014043 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.014045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.014045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.014056 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.015704 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.016208 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.016209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.016210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.016266 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.016535 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.016535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.016536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.016643 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.016697 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.016928 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.016990 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:48.017306 29336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.007271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:48983)
0811 02:32:48.007550 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.007606 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.008310 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.008952 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.008957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.009605 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.009881 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.009886 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.010655 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.010657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.011453 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.011455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.011850 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.011851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.011984 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.012532 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.012540 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.013952 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.015825 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.015833 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.015836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.016131 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.016352 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.016353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.016354 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.016467 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.016704 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.016709 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.016825 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.016916 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.017046 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":115,"threads_started":1}
I20260811 02:32:48.017791 29331 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37437
I20260811 02:32:48.017901 29331 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:48.018100 29331 heartbeater.cc:511] Master 127.17.79.62:37437 requested a full tablet report, sending...
I20260811 02:32:48.018602 28556 ts_manager.cc:194] Registered new tserver with Master: 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:48.019025 28556 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:48983
I20260811 02:32:48.020299 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.79.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.61.keytab.
Entry for principal oryx/127.17.79.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.61.keytab.
I20260811 02:32:48.047489 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:36135
--webserver_interface=127.17.79.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.61.keytab
--principal=oryx/127.17.79.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:37437,127.17.79.61:36135
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:48.129503 29340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:48.129755 29340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:48.129791 29340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:48.130937 29340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:48.131003 29340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:48.131029 29340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:48.131057 29340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:48.131086 29340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:48.132578 29340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:37437,127.17.79.61:36135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.61.keytab
--principal=oryx/127.17.79.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:36135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.79.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
W20260811 02:32:48.132748 29340 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.79.62:37437,127.17.79.61:36135'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 02:32:48.132895 29340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:48.133114 29340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:48.138013 29349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.137987 29353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.137988 29348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:48.138216 29340 server_base.cc:1034] running on GCE node
I20260811 02:32:48.138540 29340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:48.138868 29340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:48.140026 29340 hybrid_clock.cc:648] HybridClock initialized: now 1786415568140013 us; error 28 us; skew 500 ppm
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:48.142609 29340 init.cc:377] Logged in from keytab as oryx/127.17.79.61@KRBTEST.COM (short username oryx)
I20260811 02:32:48.143025 29340 webserver.cc:460] Webserver started at http://127.17.79.61:34117/ using document root <none> and password file <none>
I20260811 02:32:48.143273 29340 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.143327 29340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.143414 29340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:48.144459 29340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/instance:
uuid: "f861d17c2a2243f0b40dc95346b35d87"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "f088b7706a4d22a3edb5d15fac14876d"
server_key_iv: "058695897877ad2ff26d52f8fcf81981"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.144773 29340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal/instance:
uuid: "f861d17c2a2243f0b40dc95346b35d87"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "f088b7706a4d22a3edb5d15fac14876d"
server_key_iv: "058695897877ad2ff26d52f8fcf81981"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.146013 29340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:32:48.146829 29369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.147001 29340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.147119 29340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
uuid: "f861d17c2a2243f0b40dc95346b35d87"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "f088b7706a4d22a3edb5d15fac14876d"
server_key_iv: "058695897877ad2ff26d52f8fcf81981"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.147195 29340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.177582 29340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:48.179797 29340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:48.180022 29340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:48.184419 29340 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.61:36135
I20260811 02:32:48.184471 29457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.61:36135 every 8 connection(s)
I20260811 02:32:48.184847 29340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
I20260811 02:32:48.186096 29458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:48.187691 29458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:32:48.193235 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 29340
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.61@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:48.196903 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.188438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45704 (local address 127.17.79.62:37437)
0811 02:32:48.188532 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.188534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.188743 (+ 209us) server_negotiation.cc:407] Connection header received
0811 02:32:48.189176 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.189177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.189195 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.189272 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.189921 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.190477 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.191417 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.191594 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.191643 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.193789 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.193790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.193791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.193798 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.195510 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.195889 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.195890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.195891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.195951 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.196263 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.196264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.196264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.196402 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.196456 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.196753 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.196817 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 02:32:48.197161 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.188372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:45704)
0811 02:32:48.188607 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.188655 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.189090 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.189361 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.189365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.189624 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.189831 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.189835 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.190568 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.190569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.191345 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.191347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.191663 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.191664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.191766 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.192193 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.192201 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.193680 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.195595 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.195601 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.195603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.195817 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.196043 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.196044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.196045 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.196180 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.196470 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.196476 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.196618 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.196728 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.196887 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":114,"threads_started":1}
I20260811 02:32:48.197777 29458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.79.61@KRBTEST.COM
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.61@KRBTEST.COM for oryx/127.17.79.61@KRBTEST.COM
I20260811 02:32:48.202991 29463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.193811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57932 (local address 127.17.79.61:36135)
0811 02:32:48.193977 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.193982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.194091 (+ 109us) server_negotiation.cc:407] Connection header received
0811 02:32:48.194128 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.194129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.194140 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.194274 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.194972 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.195962 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.196916 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.197298 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.197374 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.200086 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.200093 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.200093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.200099 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.201721 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.202069 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.202072 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.202072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.202133 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.202374 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.202375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.202376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.202550 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.202712 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.202793 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.202875 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260811 02:32:48.205168 29460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.198017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.0.0.1:57934)
0811 02:32:48.198065 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.198078 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.198125 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.198396 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.198397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.198504 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.198549 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.198550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.199356 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.199357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.200116 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.200119 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.200596 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.200597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.200655 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.200981 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.200985 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.202174 (+ 1189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.204373 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.204374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.204374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.204527 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.204682 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.204682 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.204682 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.204723 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.204911 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.204912 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.204943 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.205000 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.205069 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 02:32:48.205235 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.198081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57934 (local address 127.17.79.61:36135)
0811 02:32:48.198258 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.198260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.198269 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:48.198290 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.198291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.198301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.198387 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.198623 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.199277 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.200196 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.200518 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.200594 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.202290 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.202291 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.202291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.202296 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.204302 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.204592 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.204593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.204593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.204642 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.204776 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.204777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.204777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.204858 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.204903 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.205015 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.205114 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260811 02:32:48.206503 29458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Bootstrap starting.
I20260811 02:32:48.207123 29458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:48.207396 29458 log.cc:824] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:48.208146 29458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: No bootstrap required, opened a new log
I20260811 02:32:48.209501 29458 raft_consensus.cc:348] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } }
I20260811 02:32:48.209642 29458 raft_consensus.cc:374] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:48.209692 29458 raft_consensus.cc:729] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f861d17c2a2243f0b40dc95346b35d87, State: Initialized, Role: FOLLOWER
I20260811 02:32:48.209836 29458 consensus_queue.cc:260] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } }
I20260811 02:32:48.210137 29458 sys_catalog.cc:564] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:48.210098 29466 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } } }
I20260811 02:32:48.210232 29466 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 02:32:48.211927 29487 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:48.211983 29487 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:48.213344 29340 master_runner.cc:428] Detected that this master f861d17c2a2243f0b40dc95346b35d87 is joining an existing cluster
I20260811 02:32:48.213404 29340 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.79.61:36135
I20260811 02:32:48.221782 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.214505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45710 (local address 127.17.79.62:37437)
0811 02:32:48.214549 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.214551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.214738 (+ 187us) server_negotiation.cc:407] Connection header received
0811 02:32:48.214835 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.214836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.214847 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.214876 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.215412 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.215900 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.217006 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.217260 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.217293 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.218512 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.218514 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.218514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.218521 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.220466 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.220899 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.220900 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.220901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.220960 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.221161 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.221161 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.221162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.221315 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.221378 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.221578 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.221661 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:32:48.222162 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.214689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57942 (local address 127.17.79.61:36135)
0811 02:32:48.214729 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.214730 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.214740 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:48.214817 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.214818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.214828 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.214887 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.215393 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.216116 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.217167 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.217478 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.217559 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.218960 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.218961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.218961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.218968 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.220648 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.221211 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.221211 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.221212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.221277 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.221553 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.221554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.221554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.221684 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.221751 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.221925 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.222023 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:32:48.222286 29498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.214496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:45710)
0811 02:32:48.214662 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.214674 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.214762 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.214940 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.214941 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.215197 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.215313 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.215314 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.215988 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.215989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.216901 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.216904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.217357 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.217358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.217404 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.217893 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.217898 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.218385 (+ 487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.220574 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.220575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.220575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.220821 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.221042 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.221043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.221043 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.221111 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.221405 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.221407 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.221446 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.221924 (+ 478us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.222087 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":45,"thread_start_us":144,"threads_started":1}
I20260811 02:32:48.222361 29499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.214508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.0.0.1:57942)
0811 02:32:48.214696 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.214705 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.214751 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.214892 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.214892 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.215198 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.215312 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.215314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.216201 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.216202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.217013 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.217014 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.217887 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.217889 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.217968 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.218457 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.218462 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.218848 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.220734 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.220735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.220735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.221036 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.221352 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.221353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.221353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.221439 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.221759 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.221760 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.221805 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.222105 (+ 300us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.222190 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":20,"thread_start_us":89,"threads_started":1}
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.62@KRBTEST.COM for oryx/127.17.79.61@KRBTEST.COM
I20260811 02:32:48.232218 29464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.224830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57956 (local address 127.17.79.61:36135)
0811 02:32:48.224869 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.224871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.225024 (+ 153us) server_negotiation.cc:407] Connection header received
0811 02:32:48.225122 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.225123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.225132 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.225179 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.225650 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.226097 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.227219 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.227391 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.227449 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.229656 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.229657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.229658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.229663 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.231083 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.231513 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.231514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.231514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.231562 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.231771 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.231771 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.231772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.231863 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.231912 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.232100 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.232161 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:32:48.232306 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.224732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.0.0.1:57956)
0811 02:32:48.224930 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.224970 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.225048 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.225183 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.225187 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.225517 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.225574 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.225576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.226174 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.226175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.227132 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.227135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.227470 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.227471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.227551 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.227963 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.227968 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.229556 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.231164 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.231171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.231173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.231433 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.231632 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.231632 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.231633 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.231708 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.231926 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.231933 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.231986 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.232076 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.232189 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":112,"threads_started":1}
I20260811 02:32:48.232992 28556 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.79.61:36135: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87"
member_type: NON_VOTER
last_known_addr {
host: "127.17.79.61"
port: 36135
}
attrs {
promote: true
}
}
dest_uuid: "16679289171c43bebb7590e7bec4bff5"
cas_config_opid_index: -1
I20260811 02:32:48.233328 28556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } }
I20260811 02:32:48.233815 29505 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f861d17c2a2243f0b40dc95346b35d87 (127.17.79.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } }
I20260811 02:32:48.234159 29415 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:48.234938 29505 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.79.61:36135
I20260811 02:32:48.235087 29505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } }
I20260811 02:32:48.235153 29505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:48.235163 29340 master.cc:537] Master@127.17.79.61:36135 shutting down...
I20260811 02:32:48.235163 29415 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Refusing update from remote peer 16679289171c43bebb7590e7bec4bff5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 02:32:48.235525 29501 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 02:32:48.236388 28533 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 02:32:48.236825 28533 consensus_peers.cc:487] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 -> Peer f861d17c2a2243f0b40dc95346b35d87 (127.17.79.61:36135): Couldn't send request to peer f861d17c2a2243f0b40dc95346b35d87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 02:32:48.238186 29340 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:48.238332 29340 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:48.238397 29340 tablet_replica.cc:330] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: stopping tablet replica
I20260811 02:32:48.251639 29340 master.cc:552] Master@127.17.79.61:36135 shutdown complete.
I20260811 02:32:48.251710 29340 master_runner.cc:305] Clearing existing system tablet
I20260811 02:32:48.251852 29340 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.251900 29340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.252671 29340 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:32:48.253233 29512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.253391 29340 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.253453 29340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:48.253476 29340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
uuid: "f861d17c2a2243f0b40dc95346b35d87"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "f088b7706a4d22a3edb5d15fac14876d"
server_key_iv: "058695897877ad2ff26d52f8fcf81981"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.254379 29340 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:48.256285 29340 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 02:32:48.256359 29340 log.cc:1196] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 02:32:48.256556 29340 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Deleting consensus metadata
I20260811 02:32:48.256680 29340 master_runner.cc:315] Copying system tablet from 127.17.79.62:37437
I20260811 02:32:48.257328 29340 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: tablet copy: Beginning tablet copy session from remote peer at address 127.17.79.62:37437
I20260811 02:32:48.264226 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.257764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:45714)
0811 02:32:48.257884 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.257894 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.257963 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.258108 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.258108 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.258363 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.258422 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.258424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.259404 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.259406 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.260025 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.260027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.260517 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.260518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.260574 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.261106 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.261112 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.261429 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.263257 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.263258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.263265 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.263433 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.263646 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.263647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.263647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.263698 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.263965 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.263966 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.264002 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.264053 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.264150 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":78,"threads_started":1}
I20260811 02:32:48.264253 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.257833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45714 (local address 127.17.79.62:37437)
0811 02:32:48.257882 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.257884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.257944 (+ 60us) server_negotiation.cc:407] Connection header received
0811 02:32:48.258031 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.258032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.258042 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.258104 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.258497 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.259291 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.260125 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.260431 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.260504 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.261522 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.261524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.261524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.261531 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.263155 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.263506 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.263507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.263508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.263575 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.263761 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.263762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.263762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.263897 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.263973 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.264080 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.264159 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 02:32:48.264587 28593 tablet_copy_service.cc:140] P 16679289171c43bebb7590e7bec4bff5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f861d17c2a2243f0b40dc95346b35d87 ({username='oryx', principal='oryx/127.17.79.61@KRBTEST.COM'} at 127.0.0.1:45714)
I20260811 02:32:48.264696 28593 tablet_copy_service.cc:161] P 16679289171c43bebb7590e7bec4bff5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f861d17c2a2243f0b40dc95346b35d87 at {username='oryx', principal='oryx/127.17.79.61@KRBTEST.COM'} at 127.0.0.1:45714: session id = f861d17c2a2243f0b40dc95346b35d87-00000000000000000000000000000000
I20260811 02:32:48.265347 28593 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 02:32:48.265971 29340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 02:32:48.267341 29340 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: tablet copy: Starting download of 0 data blocks...
I20260811 02:32:48.267499 29340 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: tablet copy: Starting download of 1 WAL segments...
I20260811 02:32:48.268424 29340 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 02:32:48.269369 28593 tablet_copy_service.cc:342] P 16679289171c43bebb7590e7bec4bff5: Request end of tablet copy session f861d17c2a2243f0b40dc95346b35d87-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.79.61@KRBTEST.COM'} at 127.0.0.1:45714
I20260811 02:32:48.269428 28593 tablet_copy_service.cc:433] P 16679289171c43bebb7590e7bec4bff5: ending tablet copy session f861d17c2a2243f0b40dc95346b35d87-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f861d17c2a2243f0b40dc95346b35d87
I20260811 02:32:48.271978 29340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:48.273198 29526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.273288 29525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.275353 29528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:48.275486 29340 server_base.cc:1034] running on GCE node
I20260811 02:32:48.275590 29340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:48.275785 29340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:48.276939 29340 hybrid_clock.cc:648] HybridClock initialized: now 1786415568276929 us; error 29 us; skew 500 ppm
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:48.278419 29340 init.cc:377] Logged in from keytab as oryx/127.17.79.61@KRBTEST.COM (short username oryx)
I20260811 02:32:48.278775 29340 webserver.cc:460] Webserver started at http://127.17.79.61:34917/ using document root <none> and password file <none>
I20260811 02:32:48.278903 29340 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.278944 29340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.279675 29340 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:48.280273 29536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.280424 29340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.280473 29340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
uuid: "f861d17c2a2243f0b40dc95346b35d87"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "f088b7706a4d22a3edb5d15fac14876d"
server_key_iv: "058695897877ad2ff26d52f8fcf81981"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.280530 29340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.294589 29340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:48.296200 29340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:48.299539 29340 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.61:36135
I20260811 02:32:48.299741 29628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.61:36135 every 8 connection(s)
I20260811 02:32:48.299921 29340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
I20260811 02:32:48.300737 29629 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:32:48.301194 29629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Bootstrap starting.
I20260811 02:32:48.303504 29629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:32:48.303755 29629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Bootstrap complete.
I20260811 02:32:48.303963 29629 raft_consensus.cc:348] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } }
I20260811 02:32:48.304032 29629 raft_consensus.cc:729] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f861d17c2a2243f0b40dc95346b35d87, State: Initialized, Role: LEARNER
I20260811 02:32:48.304059 29629 consensus_queue.cc:260] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } }
I20260811 02:32:48.304293 29629 sys_catalog.cc:564] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:48.304262 29633 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } }
I20260811 02:32:48.304416 29633 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: LEARNER
I20260811 02:32:48.306695 29651 catalog_manager.cc:1259] Loaded cluster ID: 9bbf71544c0e4b1fa78eacc22cbb6831
I20260811 02:32:48.306743 29651 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: loading cluster ID for follower catalog manager: success
I20260811 02:32:48.307567 29651 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: acquiring CA information for follower catalog manager: success
I20260811 02:32:48.307797 29651 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 02:32:48.312597 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.304622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.17.79.61:36135)
0811 02:32:48.304773 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.304775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.304786 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:48.304812 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.304813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.304824 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.304945 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.305678 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.307067 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.308077 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.308352 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.308408 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.309806 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.309808 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.309808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.309814 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.311322 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.311721 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.311722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.311722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.311780 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.311988 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.311989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.311989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.312102 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.312176 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.312359 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.312436 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
WARNING: no policy specified for oryx/127.17.79.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.60.keytab.
Entry for principal oryx/127.17.79.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.60.keytab.
I20260811 02:32:48.340564 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:42695
--webserver_interface=127.17.79.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.60.keytab
--principal=oryx/127.17.79.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:48.433920 29655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:48.434120 29655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:48.434142 29655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:48.435340 29655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:48.435381 29655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:48.435395 29655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:48.435408 29655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:48.435420 29655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:48.436861 29655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.60.keytab
--principal=oryx/127.17.79.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:42695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.79.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:48.437114 29655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:48.437395 29655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:48.443102 29668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.443141 29666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.443070 29664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:48.444407 29655 server_base.cc:1034] running on GCE node
I20260811 02:32:48.444702 29655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:48.445071 29655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:48.446274 29655 hybrid_clock.cc:648] HybridClock initialized: now 1786415568446246 us; error 43 us; skew 500 ppm
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:48.449292 29655 init.cc:377] Logged in from keytab as oryx/127.17.79.60@KRBTEST.COM (short username oryx)
I20260811 02:32:48.449759 29655 webserver.cc:460] Webserver started at http://127.17.79.60:34791/ using document root <none> and password file <none>
I20260811 02:32:48.449990 29655 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.450035 29655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.450176 29655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:48.451275 29655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/instance:
uuid: "a2780bf6e3054fe3af720e8809cea130"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "d5b8306a5cf9f28262a844f9d10e29de"
server_key_iv: "155c53ef6fcba4234f079b094b38f223"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.451663 29655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal/instance:
uuid: "a2780bf6e3054fe3af720e8809cea130"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "d5b8306a5cf9f28262a844f9d10e29de"
server_key_iv: "155c53ef6fcba4234f079b094b38f223"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.453054 29655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:48.453840 29678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.454077 29655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:48.454177 29655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
uuid: "a2780bf6e3054fe3af720e8809cea130"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "d5b8306a5cf9f28262a844f9d10e29de"
server_key_iv: "155c53ef6fcba4234f079b094b38f223"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.454295 29655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.469038 29655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:48.470898 29655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:48.471050 29655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:48.475268 29655 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.60:42695
I20260811 02:32:48.475355 29758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.60:42695 every 8 connection(s)
I20260811 02:32:48.475660 29655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
I20260811 02:32:48.476604 29759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:48.476650 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 29655
I20260811 02:32:48.478760 29759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.79.60@KRBTEST.COM
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.60@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:48.487223 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.479445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45718 (local address 127.17.79.62:37437)
0811 02:32:48.479512 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.479514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.479610 (+ 96us) server_negotiation.cc:407] Connection header received
0811 02:32:48.479704 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.479705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.479716 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.479792 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.480343 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.480997 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.482047 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.482282 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.482356 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.484653 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.484655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.484655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.484662 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.485926 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.486341 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.486342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.486342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.486403 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.486643 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.486644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.486645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.486758 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.486837 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.487029 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.487125 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 02:32:48.487444 29764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.477236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48046 (local address 127.17.79.60:42695)
0811 02:32:48.477424 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.477430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.477453 (+ 23us) server_negotiation.cc:407] Connection header received
0811 02:32:48.477970 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.477976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.478019 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.478166 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.478791 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.480047 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.481040 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.481490 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.481629 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.484181 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.484188 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.484189 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.484196 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.485952 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.486358 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.486361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.486361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.486452 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.486670 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.486671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.486671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.486870 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.487016 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.487110 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.487263 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260811 02:32:48.487443 29766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.479347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:45718)
0811 02:32:48.479493 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.479537 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.479638 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.479824 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.479827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.480160 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.480249 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.480252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.481103 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.481104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.481963 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.481966 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.482397 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.482398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.482487 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.482919 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.482929 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.484559 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.486026 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.486033 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.486035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.486279 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.486473 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.486474 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.486474 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.486571 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.486828 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.486834 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.486900 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.487011 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.487188 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
I20260811 02:32:48.488049 29759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.60@KRBTEST.COM for oryx/127.17.79.61@KRBTEST.COM
I20260811 02:32:48.494045 29766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.488305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.0.0.1:57986)
0811 02:32:48.488350 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.488359 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.488392 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.488570 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.488571 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.488693 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.488745 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.488747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.489338 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.489339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.489819 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.489820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.490153 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.490154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.490224 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.490598 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.490602 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.491714 (+ 1112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.493315 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.493316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.493316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.493466 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.493616 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.493616 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.493616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.493663 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.493846 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.493846 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.493877 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.493922 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.493987 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 02:32:48.494065 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.488361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.17.79.61:36135)
0811 02:32:48.488403 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.488405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.488426 (+ 21us) server_negotiation.cc:407] Connection header received
0811 02:32:48.488456 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.488457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.488465 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.488504 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.488820 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.489271 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.489890 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.490072 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.490122 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.491797 (+ 1675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.491799 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.491799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.491806 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.493241 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.493521 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.493522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.493522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.493564 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.493710 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.493710 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.493710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.493797 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.493842 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.493945 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.494004 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:32:48.494573 29759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.60@KRBTEST.COM for oryx/127.17.79.60@KRBTEST.COM
I20260811 02:32:48.500173 29766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.494811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.0.0.1:48050)
0811 02:32:48.494857 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.494867 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.494901 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.495005 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.495005 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.495108 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.495132 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.495133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.495691 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.495692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.496123 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.496124 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.496442 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.496443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.496477 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.496777 (+ 300us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.496780 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.497906 (+ 1126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.499463 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.499464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.499464 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.499609 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.499757 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.499757 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.499757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.499804 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.499970 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.499971 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.500000 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.500049 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.500116 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 02:32:48.500298 29764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.494877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48050 (local address 127.17.79.60:42695)
0811 02:32:48.494910 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.494912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.494927 (+ 15us) server_negotiation.cc:407] Connection header received
0811 02:32:48.494943 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.494944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.494951 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.495001 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.495204 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.495625 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.496188 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.496379 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.496431 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.497981 (+ 1550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.497982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.497982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.497988 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.499396 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.499663 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.499663 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.499664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.499703 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.499845 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.499845 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.499845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.499922 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.499964 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.500067 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.500161 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":16}
I20260811 02:32:48.501562 29759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Bootstrap starting.
I20260811 02:32:48.502482 29759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:48.502763 29759 log.cc:824] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:48.503485 29759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: No bootstrap required, opened a new log
I20260811 02:32:48.504984 29759 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } }
I20260811 02:32:48.505115 29759 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:48.505139 29759 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2780bf6e3054fe3af720e8809cea130, State: Initialized, Role: FOLLOWER
I20260811 02:32:48.505275 29759 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } }
I20260811 02:32:48.505582 29770 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } } }
I20260811 02:32:48.505648 29759 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:48.505666 29770 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 02:32:48.507678 29800 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:48.507741 29800 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:48.509706 29655 master_runner.cc:428] Detected that this master a2780bf6e3054fe3af720e8809cea130 is joining an existing cluster
I20260811 02:32:48.509763 29655 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.79.60:42695
I20260811 02:32:48.516877 29810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.510773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.0.0.1:48056)
0811 02:32:48.510928 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.510941 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.510995 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.511157 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.511158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.511352 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.511406 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.511408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.512076 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.512077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.512941 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.512944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.513396 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.513397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.513453 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.513871 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.513874 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.514150 (+ 276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.515858 (+ 1708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.515859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.515860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.516043 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.516247 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.516248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.516248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.516303 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.516544 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.516545 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.516582 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.516651 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.516751 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":102,"threads_started":1}
I20260811 02:32:48.516891 29764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.510948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48056 (local address 127.17.79.60:42695)
0811 02:32:48.510982 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.510984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.510992 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:32:48.511064 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.511065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.511074 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.511101 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.511493 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.511998 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.513030 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.513310 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.513384 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.514302 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.514304 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.514304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.514311 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.515755 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.516124 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.516125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.516126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.516181 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.516375 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.516376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.516376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.516480 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.516554 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.516675 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.516801 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":19}
I20260811 02:32:48.538808 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 28666
I20260811 02:32:48.547024 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.511003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57996 (local address 127.17.79.61:36135)
0811 02:32:48.511050 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.511052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.511334 (+ 282us) server_negotiation.cc:407] Connection header received
0811 02:32:48.511431 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.511431 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.511442 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.511471 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.511919 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.512427 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.513269 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.513570 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.513650 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.535475 (+ 21825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.535478 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.535478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.535488 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.537372 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.537879 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.537881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.537881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.537953 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.538613 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.538615 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.538615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.546319 (+ 7704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.546445 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.546733 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.546864 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:32:48.547596 29814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.510789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.0.0.1:57996)
0811 02:32:48.511270 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.511280 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.511359 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.511533 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.511534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.511759 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.511831 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.511833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.512533 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.512534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.513177 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.513178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.513645 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.513646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.513685 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.534916 (+ 21231us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.534924 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.535354 (+ 430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.537482 (+ 2128us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.537484 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.537485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.537790 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.538040 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.538041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.538042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.538109 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.546493 (+ 8384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.546495 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.546569 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.547147 (+ 578us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.547429 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":100,"threads_started":1}
I20260811 02:32:48.572363 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:37027
--local_ip_for_outbound_sockets=127.17.79.1
--tserver_master_addrs=127.17.79.62:37437
--webserver_port=42077
--webserver_interface=127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab
--principal=oryx/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:32:48.572772 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.511139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45726 (local address 127.17.79.62:37437)
0811 02:32:48.511179 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.511181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.514417 (+ 3236us) server_negotiation.cc:407] Connection header received
0811 02:32:48.514515 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.514516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.514526 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.514558 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.534774 (+ 20216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.535801 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.536708 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.536905 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.536989 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.537937 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.537939 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.537939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.537946 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.571315 (+ 33369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.571826 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.571828 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.571829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.571894 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.572108 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.572110 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.572111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.572291 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.572369 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.572574 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.572670 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:48.573330 29812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.511133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:45726)
0811 02:32:48.514350 (+ 3217us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.514361 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.514442 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.514630 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.514631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.534518 (+ 19887us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.534615 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.534621 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.535913 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.535914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.536603 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.536606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.536981 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.536982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.537052 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.537448 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.537453 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.537851 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.571443 (+ 33592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.571445 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.571446 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.571714 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.571973 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.571974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.571974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.572035 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.572375 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.572376 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.572432 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.572896 (+ 464us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.573019 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3200,"thread_start_us":96,"threads_started":1}
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415567, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.62@KRBTEST.COM for oryx/127.17.79.60@KRBTEST.COM
I20260811 02:32:48.583014 29764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.575954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.17.79.60:42695)
0811 02:32:48.576079 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.576081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.576086 (+ 5us) server_negotiation.cc:407] Connection header received
0811 02:32:48.576114 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.576115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.576122 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.576188 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.576480 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.577028 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.577807 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.578061 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.578251 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.580165 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.580166 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.580167 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.580174 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.581772 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.582137 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.582138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.582139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.582194 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.582485 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.582486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.582486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.582599 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.582672 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.582852 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.582922 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 02:32:48.583019 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.575916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.0.0.1:48066)
0811 02:32:48.575965 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.575976 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.576011 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.576204 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.576205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.576361 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.576401 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.576402 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.577121 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.577122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.577713 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.577715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.578253 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.578254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.578323 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.578767 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.578772 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.580086 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.581868 (+ 1782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.581869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.581869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.582058 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.582350 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.582351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.582352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.582415 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.582678 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.582679 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.582722 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.582812 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.582922 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 02:32:48.583757 28556 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.79.60:42695: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a2780bf6e3054fe3af720e8809cea130"
member_type: NON_VOTER
last_known_addr {
host: "127.17.79.60"
port: 42695
}
attrs {
promote: true
}
}
dest_uuid: "16679289171c43bebb7590e7bec4bff5"
cas_config_opid_index: 5
I20260811 02:32:48.584025 28556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } }
I20260811 02:32:48.584374 29505 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a2780bf6e3054fe3af720e8809cea130 (127.17.79.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.585453 29505 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.79.60:42695
I20260811 02:32:48.585523 29505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.585580 29505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:48.586020 29716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:48.586895 29716 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Refusing update from remote peer 16679289171c43bebb7590e7bec4bff5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 02:32:48.587162 29501 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:48.588168 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.584455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.0.0.1:58002)
0811 02:32:48.584716 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.584726 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.584784 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.584990 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.584991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.584992 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:48.585023 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.585025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.585881 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.585882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.587027 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.587030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.587939 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.587940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.587998 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.588017 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.588069 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.588107 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":80,"threads_started":1}
I20260811 02:32:48.588415 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.584626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58002 (local address 127.17.79.61:36135)
0811 02:32:48.584686 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.584688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.584835 (+ 147us) server_negotiation.cc:407] Connection header received
0811 02:32:48.584862 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.584863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.584887 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.584941 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:48.585091 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.585789 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.587181 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.587761 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.587828 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.587903 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.588316 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.588355 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 02:32:48.588609 29587 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 LEARNER]: Refusing update from remote peer 16679289171c43bebb7590e7bec4bff5: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 02:32:48.588646 29716 raft_consensus.cc:858] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } }
W20260811 02:32:48.588712 29716 raft_consensus.cc:1565] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } }
I20260811 02:32:48.588796 29501 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 02:32:48.589241 29716 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f861d17c2a2243f0b40dc95346b35d87 (127.17.79.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } }
I20260811 02:32:48.589286 29587 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a2780bf6e3054fe3af720e8809cea130 (127.17.79.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.590129 29770 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16679289171c43bebb7590e7bec4bff5. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } }
I20260811 02:32:48.590214 29770 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 02:32:48.590306 29770 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } }
I20260811 02:32:48.590355 29770 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 02:32:48.590386 29770 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } }
I20260811 02:32:48.590422 29770 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 02:32:48.590386 29633 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16679289171c43bebb7590e7bec4bff5. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.590467 29633 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: LEARNER
I20260811 02:32:48.590507 29633 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: NON_VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: true } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.590560 29633 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: LEARNER
I20260811 02:32:48.591008 29655 master.cc:537] Master@127.17.79.60:42695 shutting down...
I20260811 02:32:48.591007 29501 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: attempting to promote NON_VOTER f861d17c2a2243f0b40dc95346b35d87 to VOTER
I20260811 02:32:48.591197 29501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } }
I20260811 02:32:48.591943 29587 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 LEARNER]: Refusing update from remote peer 16679289171c43bebb7590e7bec4bff5: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 02:32:48.592114 29505 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 02:32:48.592236 28531 consensus_peers.cc:487] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 -> Peer a2780bf6e3054fe3af720e8809cea130 (127.17.79.60:42695): Couldn't send request to peer a2780bf6e3054fe3af720e8809cea130. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 02:32:48.594147 29505 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f861d17c2a2243f0b40dc95346b35d87 (127.17.79.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.594769 29820 mvcc.cc:205] Tried to move back new op lower bound from 7317158164453076992 to 7317158164390461440. Current Snapshot: MvccSnapshot[applied={T|T < 7317158164402102272}]
I20260811 02:32:48.595064 29501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.595148 29501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:48.595405 29655 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 02:32:48.595511 29655 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 02:32:48.595553 29655 tablet_replica.cc:330] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: stopping tablet replica
I20260811 02:32:48.595863 29501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.595942 29501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:48.596186 29587 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f861d17c2a2243f0b40dc95346b35d87 (127.17.79.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.597645 29831 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.597759 29831 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:32:48.613684 29655 master.cc:552] Master@127.17.79.60:42695 shutdown complete.
I20260811 02:32:48.613747 29655 master_runner.cc:305] Clearing existing system tablet
I20260811 02:32:48.613884 29655 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.613942 29655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.614791 29655 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:48.615414 29840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.615583 29655 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.615653 29655 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:48.615680 29655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
uuid: "a2780bf6e3054fe3af720e8809cea130"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "d5b8306a5cf9f28262a844f9d10e29de"
server_key_iv: "155c53ef6fcba4234f079b094b38f223"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.616417 29655 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:48.617862 29655 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 02:32:48.617934 29655 log.cc:1196] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 02:32:48.618201 29655 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Deleting consensus metadata
I20260811 02:32:48.618376 29655 master_runner.cc:315] Copying system tablet from 127.17.79.62:37437
I20260811 02:32:48.619001 29655 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: tablet copy: Beginning tablet copy session from remote peer at address 127.17.79.62:37437
I20260811 02:32:48.626492 29848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.619383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:45734)
0811 02:32:48.619516 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.619528 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.619612 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.619754 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.619755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.619970 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.620019 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.620022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.621003 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.621004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.621838 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.621842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.622352 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.622353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.622416 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.622958 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.622963 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.623395 (+ 432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.625294 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.625295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.625295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.625521 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.625762 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.625763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.625763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.625836 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.626126 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.626127 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.626185 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.626289 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.626396 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":87,"threads_started":1}
I20260811 02:32:48.626504 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.619384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45734 (local address 127.17.79.62:37437)
0811 02:32:48.619431 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.619433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.619621 (+ 188us) server_negotiation.cc:407] Connection header received
0811 02:32:48.619664 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.619665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.619677 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.619749 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.620113 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.620894 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.621936 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.622227 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.622333 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.623496 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.623497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.623497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.623505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.625194 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.625607 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.625608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.625609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.625676 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.625910 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.625911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.625911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.626043 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.626112 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.626326 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.626406 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:48.627189 28593 tablet_copy_service.cc:140] P 16679289171c43bebb7590e7bec4bff5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a2780bf6e3054fe3af720e8809cea130 ({username='oryx', principal='oryx/127.17.79.60@KRBTEST.COM'} at 127.0.0.1:45734)
I20260811 02:32:48.627269 28593 tablet_copy_service.cc:161] P 16679289171c43bebb7590e7bec4bff5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a2780bf6e3054fe3af720e8809cea130 at {username='oryx', principal='oryx/127.17.79.60@KRBTEST.COM'} at 127.0.0.1:45734: session id = a2780bf6e3054fe3af720e8809cea130-00000000000000000000000000000000
I20260811 02:32:48.628090 28593 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 02:32:48.628623 29655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 02:32:48.630023 29655 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: tablet copy: Starting download of 0 data blocks...
I20260811 02:32:48.630162 29655 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: tablet copy: Starting download of 1 WAL segments...
I20260811 02:32:48.631072 29655 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 02:32:48.632054 28593 tablet_copy_service.cc:342] P 16679289171c43bebb7590e7bec4bff5: Request end of tablet copy session a2780bf6e3054fe3af720e8809cea130-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.79.60@KRBTEST.COM'} at 127.0.0.1:45734
I20260811 02:32:48.632107 28593 tablet_copy_service.cc:433] P 16679289171c43bebb7590e7bec4bff5: ending tablet copy session a2780bf6e3054fe3af720e8809cea130-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a2780bf6e3054fe3af720e8809cea130
I20260811 02:32:48.634824 29655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:48.636096 29850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.636139 29857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:48.636677 29655 server_base.cc:1034] running on GCE node
W20260811 02:32:48.636834 29849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:48.637035 29655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:48.637187 29655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:48.638290 29655 hybrid_clock.cc:648] HybridClock initialized: now 1786415568638276 us; error 31 us; skew 500 ppm
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:48.639890 29655 init.cc:377] Logged in from keytab as oryx/127.17.79.60@KRBTEST.COM (short username oryx)
I20260811 02:32:48.640163 29655 webserver.cc:460] Webserver started at http://127.17.79.60:41891/ using document root <none> and password file <none>
I20260811 02:32:48.640285 29655 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.640323 29655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.641084 29655 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:48.641682 29869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.641863 29655 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:48.641922 29655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
uuid: "a2780bf6e3054fe3af720e8809cea130"
format_stamp: "Formatted at 2026-08-11 02:32:48 on dist-test-slave-7nm7"
server_key: "d5b8306a5cf9f28262a844f9d10e29de"
server_key_iv: "155c53ef6fcba4234f079b094b38f223"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.641980 29655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.657876 29655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:48.660136 29655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:48.663417 29655 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.60:42695
I20260811 02:32:48.663525 29940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.60:42695 every 8 connection(s)
I20260811 02:32:48.663789 29655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
I20260811 02:32:48.664791 29942 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:32:48.665442 29942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Bootstrap starting.
I20260811 02:32:48.668033 29942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:32:48.668282 29942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: Bootstrap complete.
I20260811 02:32:48.668512 29942 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } }
I20260811 02:32:48.668613 29942 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a2780bf6e3054fe3af720e8809cea130, State: Initialized, Role: LEARNER
I20260811 02:32:48.668658 29942 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } }
I20260811 02:32:48.668926 29942 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:48.668928 29947 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.669198 29947 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: LEARNER
I20260811 02:32:48.670552 29973 catalog_manager.cc:1259] Loaded cluster ID: 9bbf71544c0e4b1fa78eacc22cbb6831
I20260811 02:32:48.670755 29973 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: loading cluster ID for follower catalog manager: success
I20260811 02:32:48.671962 29973 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: acquiring CA information for follower catalog manager: success
I20260811 02:32:48.672331 29973 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 02:32:48.683871 29816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:48.684115 29816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:48.684157 29816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:48.685350 29816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:48.685415 29816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:48.685461 29816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:48.687052 29816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab
--principal=oryx/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:37027
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=42077
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:48.687318 29816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:48.687551 29816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:48.692763 29983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.692732 29989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.692996 29992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:48.693004 29816 server_base.cc:1034] running on GCE node
I20260811 02:32:48.693238 29816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:48.693499 29816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:48.694636 29816 hybrid_clock.cc:648] HybridClock initialized: now 1786415568694612 us; error 42 us; skew 500 ppm
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:48.697329 29816 init.cc:377] Logged in from keytab as oryx/127.17.79.1@KRBTEST.COM (short username oryx)
I20260811 02:32:48.697827 29816 webserver.cc:460] Webserver started at http://127.17.79.1:42077/ using document root <none> and password file <none>
I20260811 02:32:48.698078 29816 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.698143 29816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.699678 29816 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:48.700347 30001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.700585 29816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:48.700692 29816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "9c4e7f4fd08f4532971f0894ce157ae1"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "75c788472d45aa57888852084f672729"
server_key_iv: "f9fc20eeb53b676b27177d433534f940"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.701058 29816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.711650 29816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:48.713953 29816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:48.714221 29816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:48.714538 29816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:48.714862 29816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:48.714917 29816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.714963 29816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:48.714996 29816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.721340 29816 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:37027
I20260811 02:32:48.721390 30191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:37027 every 8 connection(s)
I20260811 02:32:48.721738 29816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.60@KRBTEST.COM
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.61@KRBTEST.COM
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:48.729809 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 29816
I20260811 02:32:48.729979 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 28885
I20260811 02:32:48.733966 30207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.722919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.17.79.1:33227)
0811 02:32:48.723039 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.723047 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.723382 (+ 335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.723701 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.723702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.724015 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.724229 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.724234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.725126 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.725128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.725946 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.725948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.726416 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.726552 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.727125 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.727136 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.728765 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.732401 (+ 3636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.732409 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.732411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.732700 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.732890 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.732891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.732891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.733020 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.733293 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.733298 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.733449 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.733539 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.733704 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260811 02:32:48.734509 30205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.722758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:33227 (local address 127.17.79.60:42695)
0811 02:32:48.722917 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.722919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.723116 (+ 197us) server_negotiation.cc:407] Connection header received
0811 02:32:48.723527 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.723528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.723542 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.723611 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.724333 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.725007 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726046 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.726333 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726407 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.728871 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.728872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.728872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.728880 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.732304 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.732774 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.732775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.732775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.732833 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.733082 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.733083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.733083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.733222 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.733273 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.734112 (+ 839us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.734206 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":74,"threads_started":1}
I20260811 02:32:48.735924 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.722490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:34101 (local address 127.17.79.62:37437)
0811 02:32:48.722883 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.722885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.722895 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:48.723451 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.723453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.723465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.723522 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.724345 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.725127 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726336 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.726617 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726687 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.729933 (+ 3246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.729934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.729935 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.729943 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.734680 (+ 4737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.735127 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.735129 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.735129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.735192 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.735367 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.735368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.735368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.735495 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.735533 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.735723 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.735800 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366}
I20260811 02:32:48.736258 30201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.722497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:34101)
0811 02:32:48.722668 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.722774 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.723339 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.723617 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.723621 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.724019 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.724231 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.724235 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.725228 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.725229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.726168 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.726170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.726701 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726701 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.726782 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.727478 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.727481 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.729816 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.734804 (+ 4988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.734805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.734806 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.735005 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.735258 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.735258 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.735258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.735311 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.735570 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.735571 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.735613 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.736001 (+ 388us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.736117 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":38,"thread_start_us":97,"threads_started":1}
I20260811 02:32:48.736496 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.722656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:38041 (local address 127.17.79.61:36135)
0811 02:32:48.722713 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.722715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.722887 (+ 172us) server_negotiation.cc:407] Connection header received
0811 02:32:48.723527 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.723528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.723542 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.723610 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.724345 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.725123 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726277 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.726545 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726632 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.729326 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.729328 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.729328 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.729336 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.731413 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.735322 (+ 3909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.735324 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.735324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.735397 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.735650 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.735651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.735652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.735849 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.735904 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.736243 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.736350 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:32:48.736922 30202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.722559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.17.79.1:38041)
0811 02:32:48.722778 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.722788 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.723382 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.724017 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.724018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.724160 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.724232 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.724234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.725230 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.725231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.726170 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.726171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.726625 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.726626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.726700 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.727457 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.727462 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.729230 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.734959 (+ 5729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.734960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.734961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.735214 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.735484 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.735485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.735485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.735562 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.735964 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.735964 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.736099 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.736604 (+ 505us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.736757 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":40,"thread_start_us":125,"threads_started":1}
I20260811 02:32:48.737519 30198 heartbeater.cc:347] Connected to a master server at 127.17.79.61:36135
I20260811 02:32:48.737661 30198 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:48.737932 30198 heartbeater.cc:511] Master 127.17.79.61:36135 requested a full tablet report, sending...
I20260811 02:32:48.747568 29565 ts_manager.cc:194] Registered new tserver with Master: 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027)
I20260811 02:32:48.747892 30194 heartbeater.cc:347] Connected to a master server at 127.17.79.60:42695
I20260811 02:32:48.747948 30194 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:48.748034 30194 heartbeater.cc:511] Master 127.17.79.60:42695 requested a full tablet report, sending...
I20260811 02:32:48.748406 30196 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37437
I20260811 02:32:48.748464 30196 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:48.748454 29897 ts_manager.cc:194] Registered new tserver with Master: 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027)
I20260811 02:32:48.748535 30196 heartbeater.cc:511] Master 127.17.79.62:37437 requested a full tablet report, sending...
I20260811 02:32:48.748929 28556 ts_manager.cc:194] Re-registered known tserver with Master: 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027)
I20260811 02:32:48.749341 28556 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:34101
I20260811 02:32:48.752084 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:46177
--local_ip_for_outbound_sockets=127.17.79.2
--tserver_master_addrs=127.17.79.62:37437
--webserver_port=33121
--webserver_interface=127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab
--principal=oryx/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:48.835651 30208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:48.835878 30208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:48.835917 30208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:48.837116 30208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:48.837179 30208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:48.837225 30208 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:48.838789 30208 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab
--principal=oryx/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:46177
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=33121
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:48.839039 30208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:48.839265 30208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:48.844520 30216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.844530 30218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:48.844604 30214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:48.844767 30208 server_base.cc:1034] running on GCE node
I20260811 02:32:48.844955 30208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:48.845234 30208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:48.846705 30208 hybrid_clock.cc:648] HybridClock initialized: now 1786415568846659 us; error 57 us; skew 500 ppm
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:48.849238 30208 init.cc:377] Logged in from keytab as oryx/127.17.79.2@KRBTEST.COM (short username oryx)
I20260811 02:32:48.849737 30208 webserver.cc:460] Webserver started at http://127.17.79.2:33121/ using document root <none> and password file <none>
I20260811 02:32:48.849963 30208 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:48.850047 30208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:48.851642 30208 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:48.852357 30232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.852547 30208 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:48.852651 30208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "aaea37fa8f5a479c92344445befbe98f"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "08d5caf32d59905f965d9e8d9465b221"
server_key_iv: "5fc0675acfa3c0c6c336877f309e40a5"
server_key_version: "encryptionkey@0"
I20260811 02:32:48.852998 30208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:48.863368 30208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:48.865285 30208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:48.865440 30208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:48.865670 30208 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:48.865973 30208 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:48.866027 30208 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.866066 30208 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:48.866137 30208 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:48.872900 30208 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46177
I20260811 02:32:48.872936 30427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46177 every 8 connection(s)
I20260811 02:32:48.873296 30208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:48.877511 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 30208
I20260811 02:32:48.877679 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 29105
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.61@KRBTEST.COM
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.60@KRBTEST.COM
I20260811 02:32:48.889748 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.874140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:46739 (local address 127.17.79.61:36135)
0811 02:32:48.874186 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.874189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.874567 (+ 378us) server_negotiation.cc:407] Connection header received
0811 02:32:48.875148 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.875149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.875164 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.875226 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.876214 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.876957 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.882510 (+ 5553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.882802 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.882848 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.885945 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.885947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.885947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.885956 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.887917 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.888494 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.888496 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.888496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.888567 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.888898 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.888899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.888899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.889067 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.889118 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.889532 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.889629 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:32:48.890350 30438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.874063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.17.79.2:46739)
0811 02:32:48.874379 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.874434 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.874987 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.875315 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.875319 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.875893 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.876084 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.876090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.877063 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.877063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.882371 (+ 5308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.882375 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.882944 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.882945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.883106 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.883795 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.883806 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.885805 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.888040 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.888049 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.888052 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.888387 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.888662 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.888663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.888663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.888802 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.889179 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.889187 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.889352 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.889842 (+ 490us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.890047 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":63,"thread_start_us":99,"threads_started":1}
I20260811 02:32:48.890452 30205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.874075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:60855 (local address 127.17.79.60:42695)
0811 02:32:48.874136 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.874138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.874540 (+ 402us) server_negotiation.cc:407] Connection header received
0811 02:32:48.875169 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.875171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.875221 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.875274 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.876202 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.876966 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.883900 (+ 6934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.884219 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.884272 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.887237 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.887239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.887239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.887250 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.889110 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.889529 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.889531 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.889531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.889597 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.889819 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.889820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.889820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.889956 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.890019 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.890224 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.890347 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 02:32:48.890767 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.874063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.17.79.2:60855)
0811 02:32:48.874438 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.874447 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.874986 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.875334 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.875334 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.875893 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.876084 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.876089 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.877063 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.877063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.883772 (+ 6709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.883776 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.884368 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.884369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.884443 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.884963 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.884969 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.886817 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.889205 (+ 2388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.889206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.889206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.889420 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.889677 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.889677 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.889678 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.889738 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.890061 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.890062 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.890102 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.890585 (+ 483us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.890696 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":301,"thread_start_us":64,"threads_started":1}
I20260811 02:32:48.891222 30429 heartbeater.cc:347] Connected to a master server at 127.17.79.60:42695
I20260811 02:32:48.891319 30429 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:48.891471 30429 heartbeater.cc:511] Master 127.17.79.60:42695 requested a full tablet report, sending...
I20260811 02:32:48.891928 29897 ts_manager.cc:194] Registered new tserver with Master: aaea37fa8f5a479c92344445befbe98f (127.17.79.2:46177)
I20260811 02:32:48.901036 30431 heartbeater.cc:347] Connected to a master server at 127.17.79.61:36135
I20260811 02:32:48.901122 30431 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:48.901226 30431 heartbeater.cc:511] Master 127.17.79.61:36135 requested a full tablet report, sending...
I20260811 02:32:48.901551 29565 ts_manager.cc:194] Registered new tserver with Master: aaea37fa8f5a479c92344445befbe98f (127.17.79.2:46177)
Aug 11 02:32:48 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415568, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:48.911995 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:37149
--local_ip_for_outbound_sockets=127.17.79.3
--tserver_master_addrs=127.17.79.62:37437
--webserver_port=33395
--webserver_interface=127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab
--principal=oryx/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:46713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:32:48.913479 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.874270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:53459 (local address 127.17.79.62:37437)
0811 02:32:48.874313 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.874315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.874554 (+ 239us) server_negotiation.cc:407] Connection header received
0811 02:32:48.875148 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.875149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.875163 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.875196 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:48.876193 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.876699 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.907594 (+ 30895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.907807 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.907904 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.910641 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:48.910644 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:48.910644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:48.910654 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:48.912355 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.912773 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.912774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.912775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.912825 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:48.913029 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:48.913030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:48.913030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:48.913133 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:48.913180 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.913351 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.913416 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:48.913595 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.874183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:53459)
0811 02:32:48.874428 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.874439 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.875002 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.875612 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.875612 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.875885 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:48.876082 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.876088 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.876804 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.876805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.907438 (+ 30633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.907442 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.907907 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.907908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.907987 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.908535 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:48.908541 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:48.910529 (+ 1988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:48.912439 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.912440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.912441 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.912692 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.912888 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:48.912889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:48.912890 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:48.912964 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:48.913193 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:48.913194 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:48.913248 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.913313 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.913440 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":93,"threads_started":1}
I20260811 02:32:48.914011 30430 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37437
I20260811 02:32:48.914083 30430 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:48.914172 30430 heartbeater.cc:511] Master 127.17.79.62:37437 requested a full tablet report, sending...
I20260811 02:32:48.914467 28556 ts_manager.cc:194] Re-registered known tserver with Master: aaea37fa8f5a479c92344445befbe98f (127.17.79.2:46177)
I20260811 02:32:48.914991 28556 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:53459
I20260811 02:32:48.976008 29819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.972753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.0.0.1:48070)
0811 02:32:48.972829 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:48.972843 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:48.972909 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:48.973104 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:48.973106 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:48.973108 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:48.973163 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.973165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.974162 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.974164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.974979 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:48.974982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.975784 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.975785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:48.975839 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.975843 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:48.975892 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 02:32:48.975927 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 02:32:48.976014 30205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:48.972856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48070 (local address 127.17.79.60:42695)
0811 02:32:48.972930 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:48.972932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:48.972944 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:48.972976 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:48.972977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:48.973003 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:48.973093 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:48.973236 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.974035 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.975079 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:48.975692 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:48.975775 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:48.975851 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:48.975899 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 02:32:48.975938 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 02:32:48.976385 29909 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 02:32:48.976529 29947 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16679289171c43bebb7590e7bec4bff5. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:48.976675 29947 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: LEARNER
W20260811 02:32:48.997192 30441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:48.997394 30441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:48.997418 30441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:48.998605 30441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:48.998653 30441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:48.998682 30441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:49.000396 30441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:46713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab
--principal=oryx/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:37149
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=33395
--tserver_master_addrs=127.17.79.62:37437,127.17.79.61:36135,127.17.79.60:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:49.000658 30441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:49.000888 30441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:49.006162 30453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:49.006222 30450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:49.006167 30446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:49.006568 30441 server_base.cc:1034] running on GCE node
I20260811 02:32:49.006809 30441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:49.007105 30441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:49.008291 30441 hybrid_clock.cc:648] HybridClock initialized: now 1786415569008266 us; error 24 us; skew 500 ppm
Aug 11 02:32:49 dist-test-slave-7nm7 krb5kdc[28484](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415569, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:49.010934 30441 init.cc:377] Logged in from keytab as oryx/127.17.79.3@KRBTEST.COM (short username oryx)
I20260811 02:32:49.011426 30441 webserver.cc:460] Webserver started at http://127.17.79.3:33395/ using document root <none> and password file <none>
I20260811 02:32:49.011680 30441 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:49.011770 30441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:49.013109 30441 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 02:32:49.013686 30467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:49.013863 30441 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:49.013954 30441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "8192f9fdf5374c61b0dea22e91955b04"
format_stamp: "Formatted at 2026-08-11 02:32:47 on dist-test-slave-7nm7"
server_key: "3962239aaa864d031983b409d2cd7e19"
server_key_iv: "19bddda3cc5a523e25b05de278fb7c08"
server_key_version: "encryptionkey@0"
I20260811 02:32:49.014351 30441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:49.023870 30441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:49.026312 30441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:49.026470 30441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:49.026722 30441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:49.027107 30441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:49.027158 30441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:49.027199 30441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:49.027228 30441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:49.033444 30441 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:37149
I20260811 02:32:49.033485 30659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:37149 every 8 connection(s)
I20260811 02:32:49.033836 30441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:49.038266 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 30441
Aug 11 02:32:49 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415569, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.60@KRBTEST.COM
Aug 11 02:32:49 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415569, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.61@KRBTEST.COM
Aug 11 02:32:49 dist-test-slave-7nm7 krb5kdc[28484](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415569, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:49.046707 30205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.034876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:54579 (local address 127.17.79.60:42695)
0811 02:32:49.034939 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.034941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.035201 (+ 260us) server_negotiation.cc:407] Connection header received
0811 02:32:49.036316 (+ 1115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.036317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.036336 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.036368 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.037151 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.037928 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039141 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.039461 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039499 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.042569 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.042570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.042571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.042578 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.044852 (+ 2274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.045368 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.045369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.045369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.045431 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.045856 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.045857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.045858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.045996 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.046043 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.046489 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.046573 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 02:32:49.046859 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.034575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.17.79.3:40227)
0811 02:32:49.035006 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.035053 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.036182 (+ 1129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.036462 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.036467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.036916 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:49.037043 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.037045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.038007 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.038008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.039029 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.039032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.039573 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.039653 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.040587 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:49.040593 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:49.043609 (+ 3016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:49.045513 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:49.045514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:49.045514 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:49.045773 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:49.045970 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:49.045971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:49.045971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:49.046030 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:49.046322 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:49.046323 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:49.046366 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.046443 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.046612 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":44,"thread_start_us":98,"threads_started":1}
I20260811 02:32:49.047088 30670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.034575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.17.79.3:54579)
0811 02:32:49.035024 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.035053 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.036182 (+ 1129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.036473 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.036473 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.036919 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:49.037049 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.037050 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.038043 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.038043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.039029 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.039032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.039624 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.039678 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.040404 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:49.040417 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:49.042467 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:49.044932 (+ 2465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:49.044939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:49.044941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:49.045280 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:49.045516 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:49.045517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:49.045517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:49.045762 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:49.046096 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:49.046104 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:49.046313 (+ 209us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.046836 (+ 523us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.046956 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":85,"thread_start_us":93,"threads_started":1}
I20260811 02:32:49.047286 29637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.034855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:40227 (local address 127.17.79.61:36135)
0811 02:32:49.034903 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.034905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.035156 (+ 251us) server_negotiation.cc:407] Connection header received
0811 02:32:49.036315 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.036317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.036331 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.036366 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.037151 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.037902 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039141 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.039445 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039490 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.043710 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.043712 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.043712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.043719 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.045421 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.045849 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.045850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.045850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.045908 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.046097 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.046098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.046098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.046213 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.046294 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.047109 (+ 815us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.047192 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 02:32:49.047492 30661 heartbeater.cc:347] Connected to a master server at 127.17.79.60:42695
I20260811 02:32:49.047613 30661 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:49.047787 30663 heartbeater.cc:347] Connected to a master server at 127.17.79.61:36135
I20260811 02:32:49.047820 30661 heartbeater.cc:511] Master 127.17.79.60:42695 requested a full tablet report, sending...
I20260811 02:32:49.047851 30663 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:49.047935 30663 heartbeater.cc:511] Master 127.17.79.61:36135 requested a full tablet report, sending...
I20260811 02:32:49.048281 29565 ts_manager.cc:194] Registered new tserver with Master: 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:49.048285 29897 ts_manager.cc:194] Registered new tserver with Master: 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:49.051079 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.040045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48072 (local address 127.17.79.60:42695)
0811 02:32:49.040537 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.040539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.040548 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:49.040569 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.040570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.040581 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.040649 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.041538 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.042388 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.044834 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.045134 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.045204 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.046725 (+ 1521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.046726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.046726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.046733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.049417 (+ 2684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.049825 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.049827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.049827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.049890 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.050149 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.050151 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.050151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.050350 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.050470 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.050879 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.050965 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":54,"threads_started":1}
I20260811 02:32:49.052263 30680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.040437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58012 (local address 127.17.79.61:36135)
0811 02:32:49.041124 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.041126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.041134 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:32:49.041195 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.041196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.041209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.041578 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.045216 (+ 3638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.045967 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.047347 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.047788 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.047853 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.049141 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.049142 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.049143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.049149 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.051097 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.051469 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.051470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.051470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.051530 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.051748 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.051749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.051749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.051865 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.051970 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.052066 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.052143 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":56,"threads_started":1}
I20260811 02:32:49.052600 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.034790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:55133 (local address 127.17.79.62:37437)
0811 02:32:49.034890 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.034892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.035181 (+ 289us) server_negotiation.cc:407] Connection header received
0811 02:32:49.036315 (+ 1134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.036316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.036331 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.036392 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.037154 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.037654 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039154 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.039362 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039395 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.048759 (+ 9364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.048761 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.048761 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.048770 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.051137 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.051657 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.051658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.051658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.051719 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.051940 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.051941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.051942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.052076 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.052136 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.052376 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.052487 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 02:32:49.052954 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.034580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:55133)
0811 02:32:49.035063 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.035072 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.036199 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.036472 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.036472 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.036845 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:49.037036 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.037041 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.037771 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.037771 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.039033 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.039036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.039497 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.039498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.039645 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.042930 (+ 3285us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:49.042935 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:49.048638 (+ 5703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:49.051349 (+ 2711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:49.051350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:49.051350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:49.051559 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:49.051794 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:49.051795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:49.051796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:49.051859 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:49.052192 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:49.052193 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:49.052239 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.052687 (+ 448us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.052797 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":47,"thread_start_us":86,"threads_started":1}
I20260811 02:32:49.053335 30662 heartbeater.cc:347] Connected to a master server at 127.17.79.62:37437
I20260811 02:32:49.053395 30662 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:49.053478 30662 heartbeater.cc:511] Master 127.17.79.62:37437 requested a full tablet report, sending...
I20260811 02:32:49.053750 28556 ts_manager.cc:194] Re-registered known tserver with Master: 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:49.054277 28556 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:55133
I20260811 02:32:49.054533 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.040541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45736 (local address 127.17.79.62:37437)
0811 02:32:49.041235 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.041237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.041391 (+ 154us) server_negotiation.cc:407] Connection header received
0811 02:32:49.041412 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.041413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.041424 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.041486 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.042021 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.043096 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.044691 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.049356 (+ 4665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.049421 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.050941 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.050942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.050942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.050950 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.053227 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.053603 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.053604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.053604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.053668 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.053894 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.053896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.053896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.054024 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.054113 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.054384 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.054474 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":109,"threads_started":1}
I20260811 02:32:49.056157 28556 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45736:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:49.057817 28556 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:49.058733 29832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: NON_VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: true } } }
I20260811 02:32:49.058856 29832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:49.059810 29501 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: attempting to promote NON_VOTER a2780bf6e3054fe3af720e8809cea130 to VOTER
I20260811 02:32:49.060032 29501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:49.060494 29909 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 LEARNER]: Refusing update from remote peer 16679289171c43bebb7590e7bec4bff5: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 02:32:49.060727 29838 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 02:32:49.061079 29587 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Refusing update from remote peer 16679289171c43bebb7590e7bec4bff5: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 02:32:49.061270 29838 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 02:32:49.061538 29501 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a2780bf6e3054fe3af720e8809cea130 (127.17.79.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.061679 29909 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a2780bf6e3054fe3af720e8809cea130 (127.17.79.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.062750 29501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.062788 29832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.062839 29501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:49.062808 29947 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.062902 29947 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:32:49.062844 29832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:49.062750 29505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.063027 29505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:49.063459 29587 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a2780bf6e3054fe3af720e8809cea130 (127.17.79.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.064802 29831 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16679289171c43bebb7590e7bec4bff5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:49.064900 29831 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:32:49.068121 29500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.064394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37149 (local address 127.0.0.1:46656)
0811 02:32:49.064664 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.064674 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.064702 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.064933 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.064934 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.064936 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:49.064986 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.064988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.066200 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.066201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.066935 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.066937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.067914 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.067915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.067976 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.067980 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.068007 (+ 27us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.068049 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258}
I20260811 02:32:49.068542 30699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.064506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46656 (local address 127.17.79.3:37149)
0811 02:32:49.064688 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.064693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.064705 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:49.064779 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.064781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.064795 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.065070 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:49.065128 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.066113 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.067049 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.067800 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.068296 (+ 496us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.068390 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.068415 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.068455 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260811 02:32:49.069314 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.064476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46177 (local address 127.0.0.1:51122)
0811 02:32:49.065545 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.065557 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.065626 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.065812 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.065813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.065815 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:49.065867 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.065868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.067260 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.067261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.068137 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.068140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.069076 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.069078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.069150 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.069155 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.069187 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.069228 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1051,"thread_start_us":74,"threads_started":1}
I20260811 02:32:49.069276 30552 tablet_service.cc:1467] Processing CreateTablet for tablet fdbe8474ea154b19b854750b0e67b320 (DEFAULT_TABLE table=test-table [id=bb5c6499a32741e2aac80fac6ec30ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:49.069439 29819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.064290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37027 (local address 127.0.0.1:52970)
0811 02:32:49.064521 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.064535 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.064586 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.065915 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.065916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.065918 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:49.065955 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.065956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.067156 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.067156 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.068186 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.068189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.069142 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.069143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.069203 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.069207 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.069252 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.069371 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209}
I20260811 02:32:49.069695 30697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.064394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52970 (local address 127.17.79.1:37027)
0811 02:32:49.065737 (+ 1343us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.065741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.065748 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:49.065809 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.065811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.065827 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.065908 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:49.066006 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.067074 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.068319 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.069035 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.069139 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.069245 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.069402 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.069455 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1312,"thread_start_us":130,"threads_started":1}
I20260811 02:32:49.069816 30552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdbe8474ea154b19b854750b0e67b320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:49.069949 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.064713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51122 (local address 127.17.79.2:46177)
0811 02:32:49.064975 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.064978 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.065638 (+ 660us) server_negotiation.cc:407] Connection header received
0811 02:32:49.065693 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.065695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.065711 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.065797 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:49.065972 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.067189 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.068258 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.068973 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.069682 (+ 709us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.069771 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.069800 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.069847 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":107,"threads_started":1}
I20260811 02:32:49.070447 30086 tablet_service.cc:1467] Processing CreateTablet for tablet fdbe8474ea154b19b854750b0e67b320 (DEFAULT_TABLE table=test-table [id=bb5c6499a32741e2aac80fac6ec30ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:49.070731 30086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdbe8474ea154b19b854750b0e67b320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:49.070622 30313 tablet_service.cc:1467] Processing CreateTablet for tablet fdbe8474ea154b19b854750b0e67b320 (DEFAULT_TABLE table=test-table [id=bb5c6499a32741e2aac80fac6ec30ea2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:49.070960 30313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdbe8474ea154b19b854750b0e67b320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:49.073236 30701 tablet_bootstrap.cc:492] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Bootstrap starting.
I20260811 02:32:49.073645 30702 tablet_bootstrap.cc:492] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Bootstrap starting.
I20260811 02:32:49.073935 30701 tablet_bootstrap.cc:654] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:49.074303 30701 log.cc:824] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:49.074362 30702 tablet_bootstrap.cc:654] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:49.074753 30702 log.cc:824] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:49.074750 30704 tablet_bootstrap.cc:492] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Bootstrap starting.
I20260811 02:32:49.075389 30704 tablet_bootstrap.cc:654] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:49.075598 30702 tablet_bootstrap.cc:492] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: No bootstrap required, opened a new log
I20260811 02:32:49.075656 30702 ts_tablet_manager.cc:1397] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 02:32:49.075717 30704 log.cc:824] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:49.076395 30704 tablet_bootstrap.cc:492] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: No bootstrap required, opened a new log
I20260811 02:32:49.076520 30704 ts_tablet_manager.cc:1397] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:49.076526 30701 tablet_bootstrap.cc:492] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: No bootstrap required, opened a new log
I20260811 02:32:49.076607 30701 ts_tablet_manager.cc:1397] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 02:32:49.077993 30702 raft_consensus.cc:348] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.078166 30702 raft_consensus.cc:374] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:49.078205 30702 raft_consensus.cc:729] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8192f9fdf5374c61b0dea22e91955b04, State: Initialized, Role: FOLLOWER
I20260811 02:32:49.078352 30702 consensus_queue.cc:260] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.078622 30702 ts_tablet_manager.cc:1428] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 02:32:49.078770 30662 heartbeater.cc:503] Master 127.17.79.62:37437 was elected leader, sending a full tablet report...
I20260811 02:32:49.078790 30701 raft_consensus.cc:348] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.078919 30701 raft_consensus.cc:374] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:49.078948 30701 raft_consensus.cc:729] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4e7f4fd08f4532971f0894ce157ae1, State: Initialized, Role: FOLLOWER
I20260811 02:32:49.079115 30701 consensus_queue.cc:260] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.079366 30701 ts_tablet_manager.cc:1428] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 02:32:49.079284 30704 raft_consensus.cc:348] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.079437 30704 raft_consensus.cc:374] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:49.079460 30196 heartbeater.cc:503] Master 127.17.79.62:37437 was elected leader, sending a full tablet report...
I20260811 02:32:49.079473 30704 raft_consensus.cc:729] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaea37fa8f5a479c92344445befbe98f, State: Initialized, Role: FOLLOWER
I20260811 02:32:49.079638 30704 consensus_queue.cc:260] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.079964 30704 ts_tablet_manager.cc:1428] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:49.080075 30430 heartbeater.cc:503] Master 127.17.79.62:37437 was elected leader, sending a full tablet report...
W20260811 02:32:49.124615 30435 tablet.cc:2369] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:49.150681 30710 raft_consensus.cc:482] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:49.150846 30710 raft_consensus.cc:504] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.151237 30710 leader_election.cc:288] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027), 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:49.154053 30697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.151541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:40271 (local address 127.17.79.1:37027)
0811 02:32:49.151600 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.151602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.151651 (+ 49us) server_negotiation.cc:407] Connection header received
0811 02:32:49.151682 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.151683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.151697 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.151748 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:49.151920 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.152405 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.153329 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.153689 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.153777 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.153789 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.153942 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.153982 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 02:32:49.154053 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.151468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37027 (local address 127.17.79.2:40271)
0811 02:32:49.151532 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.151545 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.151591 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.151770 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.151771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.151773 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:49.151847 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.151849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.152494 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.152495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.153233 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.153235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.153785 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.153786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.153865 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.153868 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.153936 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.153978 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 02:32:49.154170 30436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.151629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37149 (local address 127.17.79.2:55333)
0811 02:32:49.151662 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:49.151670 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:49.151733 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:49.151903 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:49.151904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:49.151908 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:49.151974 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.151975 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.152597 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.152598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.153332 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:49.153334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.153894 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.153895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:49.153980 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.153982 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:49.154049 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 02:32:49.154087 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 02:32:49.154160 30699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.151687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:55333 (local address 127.17.79.3:37149)
0811 02:32:49.151765 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.151767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.151777 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:49.151805 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.151806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.151824 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.151884 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:49.152046 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.152509 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.153428 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.153808 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.153894 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.153905 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.154056 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.154096 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:32:49.154580 30119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe8474ea154b19b854750b0e67b320" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" is_pre_election: true
I20260811 02:32:49.154572 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe8474ea154b19b854750b0e67b320" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8192f9fdf5374c61b0dea22e91955b04" is_pre_election: true
I20260811 02:32:49.154744 30119 raft_consensus.cc:2454] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 0.
I20260811 02:32:49.154754 30578 raft_consensus.cc:2454] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 0.
I20260811 02:32:49.154980 30237 leader_election.cc:302] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8192f9fdf5374c61b0dea22e91955b04, aaea37fa8f5a479c92344445befbe98f; no voters:
I20260811 02:32:49.155120 30710 raft_consensus.cc:2781] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:49.155180 30710 raft_consensus.cc:482] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:49.155216 30710 raft_consensus.cc:3037] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:49.156038 30710 raft_consensus.cc:504] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.156168 30710 leader_election.cc:288] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 election: Requested vote from peers 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027), 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:49.156334 30119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe8474ea154b19b854750b0e67b320" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4e7f4fd08f4532971f0894ce157ae1"
I20260811 02:32:49.156340 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdbe8474ea154b19b854750b0e67b320" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8192f9fdf5374c61b0dea22e91955b04"
I20260811 02:32:49.156441 30119 raft_consensus.cc:3037] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:49.156438 30578 raft_consensus.cc:3037] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:49.157248 30578 raft_consensus.cc:2454] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 1.
I20260811 02:32:49.157471 30237 leader_election.cc:302] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8192f9fdf5374c61b0dea22e91955b04, aaea37fa8f5a479c92344445befbe98f; no voters:
I20260811 02:32:49.157569 30710 raft_consensus.cc:2781] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:49.157748 30710 raft_consensus.cc:686] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 1 LEADER]: Becoming Leader. State: Replica: aaea37fa8f5a479c92344445befbe98f, State: Running, Role: LEADER
I20260811 02:32:49.157815 30119 raft_consensus.cc:2454] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 1.
I20260811 02:32:49.157852 30710 consensus_queue.cc:237] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:49.158924 28559 catalog_manager.cc:5495] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f reported cstate change: term changed from 0 to 1, leader changed from <none> to aaea37fa8f5a479c92344445befbe98f (127.17.79.2). New cstate: current_term: 1 leader_uuid: "aaea37fa8f5a479c92344445befbe98f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } health_report { overall_health: HEALTHY } } }
I20260811 02:32:49.185163 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.182622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51126 (local address 127.17.79.2:46177)
0811 02:32:49.182688 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.182689 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.182698 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:49.182779 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.182780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.182813 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.182906 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:49.183101 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.183572 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.184378 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.184571 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.184637 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.184792 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:49.184891 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:49.184954 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.184990 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.185011 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 02:32:49.187209 30578 raft_consensus.cc:1261] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Refusing update from remote peer aaea37fa8f5a479c92344445befbe98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:49.187204 30119 raft_consensus.cc:1261] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 1 FOLLOWER]: Refusing update from remote peer aaea37fa8f5a479c92344445befbe98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:49.187546 30712 consensus_queue.cc:1035] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:49.187716 30710 consensus_queue.cc:1035] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:49.192394 30721 mvcc.cc:205] Tried to move back new op lower bound from 7317158171387654144 to 7317158171271061504. Current Snapshot: MvccSnapshot[applied={T|T < 7317158171387654144 or (T in {7317158171387654144})}]
I20260811 02:32:49.193091 28556 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:49.193181 28556 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45736:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:49.194661 28556 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16679289171c43bebb7590e7bec4bff5: Sending DeleteTablet for 3 replicas of tablet fdbe8474ea154b19b854750b0e67b320
I20260811 02:32:49.195024 30086 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe8474ea154b19b854750b0e67b320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:49 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:52970
I20260811 02:32:49.195161 30552 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe8474ea154b19b854750b0e67b320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:49 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:46656
I20260811 02:32:49.195245 30313 tablet_service.cc:1514] Processing DeleteTablet for tablet fdbe8474ea154b19b854750b0e67b320 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:49 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:51122
I20260811 02:32:49.195382 30733 tablet_replica.cc:330] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: stopping tablet replica
I20260811 02:32:49.195454 30732 tablet_replica.cc:330] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: stopping tablet replica
I20260811 02:32:49.195478 30733 raft_consensus.cc:2229] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:49.195533 30732 raft_consensus.cc:2229] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:49.195575 30733 raft_consensus.cc:2258] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:49.195612 30732 raft_consensus.cc:2258] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:49.196105 30734 tablet_replica.cc:330] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: stopping tablet replica
I20260811 02:32:49.196237 30733 ts_tablet_manager.cc:1905] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:49.196305 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 28506
I20260811 02:32:49.200042 30732 ts_tablet_manager.cc:1905] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:49.202629 30732 ts_tablet_manager.cc:1918] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:49.202741 30732 log.cc:1196] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/fdbe8474ea154b19b854750b0e67b320
I20260811 02:32:49.203105 30732 ts_tablet_manager.cc:1939] T fdbe8474ea154b19b854750b0e67b320 P 9c4e7f4fd08f4532971f0894ce157ae1: Deleting consensus metadata
I20260811 02:32:49.204950 30733 ts_tablet_manager.cc:1918] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:49.205044 30733 log.cc:1196] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/fdbe8474ea154b19b854750b0e67b320
I20260811 02:32:49.205344 30733 ts_tablet_manager.cc:1939] T fdbe8474ea154b19b854750b0e67b320 P 8192f9fdf5374c61b0dea22e91955b04: Deleting consensus metadata
I20260811 02:32:49.206832 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.195791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48088 (local address 127.17.79.60:42695)
0811 02:32:49.195845 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.195847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.196080 (+ 233us) server_negotiation.cc:407] Connection header received
0811 02:32:49.196105 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.196105 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.196119 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.196170 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.197080 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.198103 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.199620 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.199938 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.200014 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.203356 (+ 3342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.203358 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.203359 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.203369 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.205283 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.205784 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.205786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.205786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.205847 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.206064 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.206065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.206065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.206220 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.206328 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.206644 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.206741 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:32:49.210144 30734 raft_consensus.cc:2229] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:49.210413 30734 raft_consensus.cc:2258] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:49.211865 30734 ts_tablet_manager.cc:1905] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:49.214043 30734 ts_tablet_manager.cc:1918] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:49.214131 30734 log.cc:1196] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/fdbe8474ea154b19b854750b0e67b320
I20260811 02:32:49.214553 30734 ts_tablet_manager.cc:1939] T fdbe8474ea154b19b854750b0e67b320 P aaea37fa8f5a479c92344445befbe98f: Deleting consensus metadata
W20260811 02:32:49.217839 30234 connection.cc:535] server connection from 127.0.0.1:51122 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 02:32:49.217900 30473 connection.cc:535] server connection from 127.0.0.1:46656 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 02:32:49.217921 30002 connection.cc:535] server connection from 127.0.0.1:52970 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 02:32:49.227674 30680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.219898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58026 (local address 127.17.79.61:36135)
0811 02:32:49.219946 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.219948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.220186 (+ 238us) server_negotiation.cc:407] Connection header received
0811 02:32:49.220312 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.220313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.220328 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.220379 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.221239 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.221881 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.222836 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.223151 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.223189 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.224729 (+ 1540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.224731 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.224731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.224739 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.226308 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.226652 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.226653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.226654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.226903 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.227128 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.227128 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.227129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.227249 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.227369 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.227468 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.227548 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:32:49.228858 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:49.219984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48094 (local address 127.17.79.60:42695)
0811 02:32:49.220029 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:49.220032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:49.220153 (+ 121us) server_negotiation.cc:407] Connection header received
0811 02:32:49.220221 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:49.220222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:49.220235 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:49.220301 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:49.221568 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.222404 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.223374 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:49.224048 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:49.224126 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:49.225773 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:49.225774 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:49.225775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:49.225783 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:49.227486 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.228207 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.228208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.228209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.228263 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:49.228461 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:49.228461 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:49.228461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:49.228551 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:49.228613 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:49.228743 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 02:32:49.228802 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:32:50.192368 30749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.191943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:43049)
0811 02:32:50.192178 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.192276 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":75,"threads_started":1}
W20260811 02:32:50.192642 30196 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:37437 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.192924 30750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.192702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:60295)
0811 02:32:50.192807 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.192878 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":51,"threads_started":1}
W20260811 02:32:50.193118 30662 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:37437 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.193367 30754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.193114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:43973)
0811 02:32:50.193255 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.193329 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
W20260811 02:32:50.193547 30430 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:37437 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.695621 30759 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16679289171c43bebb7590e7bec4bff5)
I20260811 02:32:50.695750 30761 raft_consensus.cc:482] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16679289171c43bebb7590e7bec4bff5)
I20260811 02:32:50.695833 30759 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:50.695926 30761 raft_consensus.cc:504] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:50.696759 30761 leader_election.cc:288] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437), a2780bf6e3054fe3af720e8809cea130 (127.17.79.60:42695)
I20260811 02:32:50.696802 30762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.696361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46190)
0811 02:32:50.696482 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.696541 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":55,"threads_started":1}
I20260811 02:32:50.696455 30759 leader_election.cc:288] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437), f861d17c2a2243f0b40dc95346b35d87 (127.17.79.61:36135)
W20260811 02:32:50.696946 29874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.696990 30765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.696661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46202)
0811 02:32:50.696894 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.696951 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":51,"threads_started":1}
W20260811 02:32:50.697180 29547 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.697835 30765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.697743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46206)
0811 02:32:50.697777 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.697805 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 02:32:50.697856 30762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.697758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46218)
0811 02:32:50.697804 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.697828 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 02:32:50.697930 29874 leader_election.cc:334] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437): Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
W20260811 02:32:50.697969 29547 leader_election.cc:334] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437): Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.700814 30768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.696886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48108 (local address 127.17.79.60:42695)
0811 02:32:50.697007 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:50.697009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:50.697019 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:50.697226 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:50.697227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:50.697242 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:50.697333 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:50.697524 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.698378 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.699884 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.700448 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.700533 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:50.700546 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:50.700695 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 02:32:50.700742 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260811 02:32:50.700820 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.696662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:42695 (local address 127.0.0.1:48108)
0811 02:32:50.696949 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.696960 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:50.697012 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:50.697387 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:50.697389 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:50.697391 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:50.697449 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:50.697452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.698473 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.698475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:50.699775 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:50.699778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.700549 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.700550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:50.700607 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:50.700612 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:50.700669 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 02:32:50.700748 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":62,"threads_started":1}
I20260811 02:32:50.701025 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.696382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:36135 (local address 127.0.0.1:58042)
0811 02:32:50.696526 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.696540 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:50.696631 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:50.697354 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:50.697355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:50.697357 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:50.697410 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:50.697413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.698709 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.698710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:50.699959 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:50.699962 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.700750 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.700751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:50.700820 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:50.700825 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:50.700882 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 02:32:50.700935 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":39,"threads_started":1}
I20260811 02:32:50.701092 29909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f861d17c2a2243f0b40dc95346b35d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a2780bf6e3054fe3af720e8809cea130" is_pre_election: true
I20260811 02:32:50.701156 30764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.696499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58042 (local address 127.17.79.61:36135)
0811 02:32:50.696605 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:50.696607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:50.696620 (+ 13us) server_negotiation.cc:407] Connection header received
0811 02:32:50.696700 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:50.696701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:50.696714 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:50.696782 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:50.697494 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.698627 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.700053 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:50.700633 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:50.700721 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:50.700732 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:50.701036 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 02:32:50.701107 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":52,"threads_started":1}
I20260811 02:32:50.701210 29909 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f861d17c2a2243f0b40dc95346b35d87 in term 1.
I20260811 02:32:50.701375 29537 leader_election.cc:302] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2780bf6e3054fe3af720e8809cea130, f861d17c2a2243f0b40dc95346b35d87; no voters: 16679289171c43bebb7590e7bec4bff5
I20260811 02:32:50.701453 29587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2780bf6e3054fe3af720e8809cea130" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f861d17c2a2243f0b40dc95346b35d87" is_pre_election: true
I20260811 02:32:50.701539 29587 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2780bf6e3054fe3af720e8809cea130 in term 1.
I20260811 02:32:50.701579 30761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 02:32:50.701650 30761 raft_consensus.cc:482] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16679289171c43bebb7590e7bec4bff5)
I20260811 02:32:50.701689 30761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 1 FOLLOWER]: Advancing to term 2
I20260811 02:32:50.701726 29871 leader_election.cc:302] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2780bf6e3054fe3af720e8809cea130, f861d17c2a2243f0b40dc95346b35d87; no voters: 16679289171c43bebb7590e7bec4bff5
I20260811 02:32:50.701828 30759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 02:32:50.701900 30759 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16679289171c43bebb7590e7bec4bff5)
I20260811 02:32:50.701931 30759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 1 FOLLOWER]: Advancing to term 2
I20260811 02:32:50.702646 30761 raft_consensus.cc:504] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:50.702796 30761 leader_election.cc:288] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 2 election: Requested vote from peers 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437), a2780bf6e3054fe3af720e8809cea130 (127.17.79.60:42695)
I20260811 02:32:50.702850 30759 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:50.702977 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.702883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46220)
0811 02:32:50.702918 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.702949 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 02:32:50.702988 30759 leader_election.cc:288] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [CANDIDATE]: Term 2 election: Requested vote from peers 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437), f861d17c2a2243f0b40dc95346b35d87 (127.17.79.61:36135)
I20260811 02:32:50.702957 29909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f861d17c2a2243f0b40dc95346b35d87" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a2780bf6e3054fe3af720e8809cea130"
I20260811 02:32:50.703052 29909 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f861d17c2a2243f0b40dc95346b35d87 in current term 2: Already voted for candidate a2780bf6e3054fe3af720e8809cea130 in this term.
I20260811 02:32:50.703265 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.703073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46226)
0811 02:32:50.703204 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.703237 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260811 02:32:50.703274 29587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a2780bf6e3054fe3af720e8809cea130" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f861d17c2a2243f0b40dc95346b35d87"
I20260811 02:32:50.703356 29587 raft_consensus.cc:2379] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a2780bf6e3054fe3af720e8809cea130 in current term 2: Already voted for candidate f861d17c2a2243f0b40dc95346b35d87 in this term.
I20260811 02:32:50.703481 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.703397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46240)
0811 02:32:50.703431 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.703457 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 02:32:50.703594 29547 leader_election.cc:334] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437): Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.703644 29547 leader_election.cc:302] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f861d17c2a2243f0b40dc95346b35d87; no voters: 16679289171c43bebb7590e7bec4bff5, a2780bf6e3054fe3af720e8809cea130
I20260811 02:32:50.703738 30761 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 02:32:50.704054 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:50.703955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46252)
0811 02:32:50.704006 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:50.704031 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 02:32:50.704140 29874 leader_election.cc:334] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437): Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:50.704181 29874 leader_election.cc:302] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2780bf6e3054fe3af720e8809cea130; no voters: 16679289171c43bebb7590e7bec4bff5, f861d17c2a2243f0b40dc95346b35d87
I20260811 02:32:50.704259 30759 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 02:32:51.193363 30772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:51.193009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:60445)
0811 02:32:51.193251 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:51.193304 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":170,"threads_started":1}
I20260811 02:32:51.193697 30773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:51.193396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:55423)
0811 02:32:51.193598 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:51.193636 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":71,"threads_started":1}
I20260811 02:32:51.194026 30774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:51.193841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:55573)
0811 02:32:51.193951 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:51.193990 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":62,"threads_started":1}
I20260811 02:32:52.194595 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.194156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:38011)
0811 02:32:52.194476 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.194531 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":226,"threads_started":1}
I20260811 02:32:52.194701 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.194395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:42007)
0811 02:32:52.194613 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.194659 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":62,"threads_started":1}
I20260811 02:32:52.194924 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.194667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:58975)
0811 02:32:52.194841 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.194876 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":65,"threads_started":1}
I20260811 02:32:52.264604 30780 raft_consensus.cc:482] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:52.264708 30780 raft_consensus.cc:504] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:52.264892 30780 leader_election.cc:288] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437), a2780bf6e3054fe3af720e8809cea130 (127.17.79.60:42695)
I20260811 02:32:52.265141 29909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f861d17c2a2243f0b40dc95346b35d87" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a2780bf6e3054fe3af720e8809cea130" is_pre_election: true
I20260811 02:32:52.265228 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.264998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46474)
0811 02:32:52.265140 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.265188 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260811 02:32:52.265264 29909 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f861d17c2a2243f0b40dc95346b35d87 in term 2.
I20260811 02:32:52.265458 29537 leader_election.cc:302] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2780bf6e3054fe3af720e8809cea130, f861d17c2a2243f0b40dc95346b35d87; no voters:
I20260811 02:32:52.265568 30780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 02:32:52.265612 30780 raft_consensus.cc:482] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:52.265668 30780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 2 FOLLOWER]: Advancing to term 3
I20260811 02:32:52.265718 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.265608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46476)
0811 02:32:52.265661 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.265689 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 02:32:52.265797 29547 leader_election.cc:334] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437): Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:52.266445 30780 raft_consensus.cc:504] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:52.266580 30780 leader_election.cc:288] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 3 election: Requested vote from peers 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437), a2780bf6e3054fe3af720e8809cea130 (127.17.79.60:42695)
I20260811 02:32:52.266783 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.266656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46484)
0811 02:32:52.266706 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.266757 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 02:32:52.266765 29909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f861d17c2a2243f0b40dc95346b35d87" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a2780bf6e3054fe3af720e8809cea130"
I20260811 02:32:52.266846 29909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 2 FOLLOWER]: Advancing to term 3
I20260811 02:32:52.267179 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.267072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46488)
0811 02:32:52.267130 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.267159 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 02:32:52.267264 29547 leader_election.cc:334] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437): Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
I20260811 02:32:52.267622 29909 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f861d17c2a2243f0b40dc95346b35d87 in term 3.
I20260811 02:32:52.267798 29537 leader_election.cc:302] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2780bf6e3054fe3af720e8809cea130, f861d17c2a2243f0b40dc95346b35d87; no voters: 16679289171c43bebb7590e7bec4bff5
I20260811 02:32:52.267895 30780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 02:32:52.268016 30780 raft_consensus.cc:686] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [term 3 LEADER]: Becoming Leader. State: Replica: f861d17c2a2243f0b40dc95346b35d87, State: Running, Role: LEADER
I20260811 02:32:52.268092 30780 consensus_queue.cc:237] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } }
I20260811 02:32:52.268507 30785 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f861d17c2a2243f0b40dc95346b35d87. Latest consensus state: current_term: 3 leader_uuid: "f861d17c2a2243f0b40dc95346b35d87" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:52.268606 30785 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:52.268790 30787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:52.269273 30787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:52.269356 30787 catalog_manager.cc:1259] Loaded cluster ID: 9bbf71544c0e4b1fa78eacc22cbb6831
I20260811 02:32:52.269388 30787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:52.269564 30787 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:52.269663 30787 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Loaded TSK: 0
I20260811 02:32:52.269802 30787 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:32:52.313853 29565 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:52.315590 29565 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:52.316898 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.316768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46498)
0811 02:32:52.316827 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.316861 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:32:52.316962 29909 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [term 3 FOLLOWER]: Refusing update from remote peer f861d17c2a2243f0b40dc95346b35d87: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 02:32:52.317289 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.317190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.0.0.1:46514)
0811 02:32:52.317240 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.317271 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 02:32:52.317236 30785 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 02:32:52.317406 29547 consensus_peers.cc:487] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 -> Peer 16679289171c43bebb7590e7bec4bff5 (127.17.79.62:37437): Couldn't send request to peer 16679289171c43bebb7590e7bec4bff5. Status: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 02:32:52.317952 30790 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f861d17c2a2243f0b40dc95346b35d87. Latest consensus state: current_term: 3 leader_uuid: "f861d17c2a2243f0b40dc95346b35d87" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:52.318074 30790 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:32:52.318809 30785 sys_catalog.cc:455] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "f861d17c2a2243f0b40dc95346b35d87" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:52.318898 30785 sys_catalog.cc:458] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:52.318905 30790 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "f861d17c2a2243f0b40dc95346b35d87" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "16679289171c43bebb7590e7bec4bff5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 37437 } } peers { permanent_uuid: "f861d17c2a2243f0b40dc95346b35d87" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 36135 } attrs { promote: false } } peers { permanent_uuid: "a2780bf6e3054fe3af720e8809cea130" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 42695 } attrs { promote: false } } }
I20260811 02:32:52.318994 30790 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2780bf6e3054fe3af720e8809cea130 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:32:52.324477 30799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.321142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37149 (local address 127.0.0.1:46658)
0811 02:32:52.321419 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.321429 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:52.321485 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:52.321752 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:52.321753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:52.321755 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:52.321803 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:52.321805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.322701 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.322702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:52.323556 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:52.323558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.324231 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.324231 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:52.324294 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:52.324298 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:52.324359 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 02:32:52.324401 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":36,"thread_start_us":91,"threads_started":1}
I20260811 02:32:52.324681 30802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.321220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46658 (local address 127.17.79.3:37149)
0811 02:32:52.321593 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:52.321595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:52.321602 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:52.321633 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:52.321634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:52.321642 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:52.321732 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:52.321894 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.322631 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.323663 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.324143 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.324217 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:52.324230 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:52.324482 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 02:32:52.324574 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":90,"threads_started":1}
I20260811 02:32:52.324824 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.321323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46177 (local address 127.0.0.1:51142)
0811 02:32:52.321438 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.321448 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:52.321499 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:52.321926 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:52.321927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:52.321929 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:52.321962 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:52.321963 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.322687 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.322688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:52.323864 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:52.323866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.324571 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.324572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:52.324648 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:52.324652 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:52.324680 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 02:32:52.324718 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":25,"thread_start_us":69,"threads_started":1}
I20260811 02:32:52.325156 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.321402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.17.79.2:46177)
0811 02:32:52.321812 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:52.321814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:52.321822 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:32:52.321847 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:52.321848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:52.321860 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:52.321916 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:52.322011 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.322575 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.323966 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.324472 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.324992 (+ 520us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:52.325011 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:52.325030 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 02:32:52.325081 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":73,"threads_started":1}
I20260811 02:32:52.325169 30552 tablet_service.cc:1467] Processing CreateTablet for tablet 2bdecc2a32124cf6b244dec47bc5c2b1 (DEFAULT_TABLE table=test-table [id=c65e52e8609546c7be0d1bdd0613bd47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:52.325371 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.321004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37027 (local address 127.0.0.1:52978)
0811 02:32:52.321078 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.321091 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:52.321155 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:52.321546 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:52.321548 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:52.321549 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:52.321612 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:52.321613 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.322635 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.322637 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:52.323869 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:52.323871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.325147 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.325148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:52.325211 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:52.325217 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:32:52.325276 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 02:32:52.325316 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":38}
I20260811 02:32:52.325392 30552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bdecc2a32124cf6b244dec47bc5c2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:52.325371 30313 tablet_service.cc:1467] Processing CreateTablet for tablet 2bdecc2a32124cf6b244dec47bc5c2b1 (DEFAULT_TABLE table=test-table [id=c65e52e8609546c7be0d1bdd0613bd47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:52.325448 30801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.321166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52978 (local address 127.17.79.1:37027)
0811 02:32:52.321386 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:52.321388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:52.321397 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:52.321427 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:52.321428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:52.321440 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:52.321697 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:52.321737 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.322550 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.323953 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.324788 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.325156 (+ 368us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:52.325180 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:52.325285 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 02:32:52.325355 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":59,"threads_started":1}
I20260811 02:32:52.325487 30313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bdecc2a32124cf6b244dec47bc5c2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:52.325802 30086 tablet_service.cc:1467] Processing CreateTablet for tablet 2bdecc2a32124cf6b244dec47bc5c2b1 (DEFAULT_TABLE table=test-table [id=c65e52e8609546c7be0d1bdd0613bd47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:52.325950 30086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bdecc2a32124cf6b244dec47bc5c2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:52.327179 30812 tablet_bootstrap.cc:492] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Bootstrap starting.
I20260811 02:32:52.327255 30814 tablet_bootstrap.cc:492] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1: Bootstrap starting.
I20260811 02:32:52.327304 30809 tablet_bootstrap.cc:492] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: Bootstrap starting.
I20260811 02:32:52.327708 30814 tablet_bootstrap.cc:654] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:52.328243 30812 tablet_bootstrap.cc:654] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:52.328433 30814 tablet_bootstrap.cc:492] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1: No bootstrap required, opened a new log
I20260811 02:32:52.328490 30814 ts_tablet_manager.cc:1397] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:52.328579 30809 tablet_bootstrap.cc:654] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:52.328617 30814 raft_consensus.cc:348] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.328696 30814 raft_consensus.cc:374] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:52.328724 30814 raft_consensus.cc:729] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4e7f4fd08f4532971f0894ce157ae1, State: Initialized, Role: FOLLOWER
I20260811 02:32:52.328778 30814 consensus_queue.cc:260] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.328987 30814 ts_tablet_manager.cc:1428] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:52.329228 30812 tablet_bootstrap.cc:492] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: No bootstrap required, opened a new log
I20260811 02:32:52.329352 30812 ts_tablet_manager.cc:1397] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:52.329412 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.329258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:33405)
0811 02:32:52.329348 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.329381 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 02:32:52.329500 30812 raft_consensus.cc:348] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.329615 30812 raft_consensus.cc:374] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:52.329646 30812 raft_consensus.cc:729] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8192f9fdf5374c61b0dea22e91955b04, State: Initialized, Role: FOLLOWER
I20260811 02:32:52.329716 30812 consensus_queue.cc:260] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.329761 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.329682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:55823)
0811 02:32:52.329716 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.329739 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 02:32:52.329902 30812 ts_tablet_manager.cc:1428] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:52.329950 30198 heartbeater.cc:503] Master 127.17.79.61:36135 was elected leader, sending a full tablet report...
I20260811 02:32:52.330259 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.330112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:59039)
0811 02:32:52.330165 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.330202 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 02:32:52.330385 30809 tablet_bootstrap.cc:492] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: No bootstrap required, opened a new log
I20260811 02:32:52.330449 30809 ts_tablet_manager.cc:1397] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:52.330560 30809 raft_consensus.cc:348] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.330642 30809 raft_consensus.cc:374] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:52.330668 30809 raft_consensus.cc:729] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaea37fa8f5a479c92344445befbe98f, State: Initialized, Role: FOLLOWER
I20260811 02:32:52.330713 30809 consensus_queue.cc:260] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.330919 30809 ts_tablet_manager.cc:1428] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:52.331161 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.331060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:46187)
0811 02:32:52.331106 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.331133 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 02:32:52.331684 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.331523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:54905)
0811 02:32:52.331619 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.331653 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 02:32:52.331753 30663 heartbeater.cc:503] Master 127.17.79.61:36135 was elected leader, sending a full tablet report...
I20260811 02:32:52.331830 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.331699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:44241)
0811 02:32:52.331761 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.331795 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 02:32:52.332054 30431 heartbeater.cc:503] Master 127.17.79.61:36135 was elected leader, sending a full tablet report...
W20260811 02:32:52.474682 30200 tablet.cc:2369] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:52.500569 30827 raft_consensus.cc:482] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:52.500700 30827 raft_consensus.cc:504] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.500903 30827 leader_election.cc:288] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027), 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:52.501196 30119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdecc2a32124cf6b244dec47bc5c2b1" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" is_pre_election: true
I20260811 02:32:52.501291 30119 raft_consensus.cc:2454] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 0.
I20260811 02:32:52.501246 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdecc2a32124cf6b244dec47bc5c2b1" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8192f9fdf5374c61b0dea22e91955b04" is_pre_election: true
I20260811 02:32:52.501394 30578 raft_consensus.cc:2454] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 0.
I20260811 02:32:52.501492 30237 leader_election.cc:302] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4e7f4fd08f4532971f0894ce157ae1, aaea37fa8f5a479c92344445befbe98f; no voters:
I20260811 02:32:52.501618 30827 raft_consensus.cc:2781] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:52.501693 30827 raft_consensus.cc:482] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:52.501722 30827 raft_consensus.cc:3037] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:52.502543 30827 raft_consensus.cc:504] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.502692 30827 leader_election.cc:288] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 election: Requested vote from peers 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027), 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149)
I20260811 02:32:52.502993 30119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdecc2a32124cf6b244dec47bc5c2b1" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4e7f4fd08f4532971f0894ce157ae1"
I20260811 02:32:52.502990 30578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdecc2a32124cf6b244dec47bc5c2b1" candidate_uuid: "aaea37fa8f5a479c92344445befbe98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8192f9fdf5374c61b0dea22e91955b04"
I20260811 02:32:52.503088 30119 raft_consensus.cc:3037] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:52.503088 30578 raft_consensus.cc:3037] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:52.503921 30119 raft_consensus.cc:2454] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 1.
I20260811 02:32:52.503921 30578 raft_consensus.cc:2454] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aaea37fa8f5a479c92344445befbe98f in term 1.
I20260811 02:32:52.504118 30237 leader_election.cc:302] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8192f9fdf5374c61b0dea22e91955b04, aaea37fa8f5a479c92344445befbe98f; no voters:
I20260811 02:32:52.504278 30827 raft_consensus.cc:2781] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:52.504488 30827 raft_consensus.cc:686] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 1 LEADER]: Becoming Leader. State: Replica: aaea37fa8f5a479c92344445befbe98f, State: Running, Role: LEADER
I20260811 02:32:52.504560 30827 consensus_queue.cc:237] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } }
I20260811 02:32:52.504940 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.504813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:41515)
0811 02:32:52.504860 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.504905 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 02:32:52.505645 29565 catalog_manager.cc:5495] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f reported cstate change: term changed from 0 to 1, leader changed from <none> to aaea37fa8f5a479c92344445befbe98f (127.17.79.2). New cstate: current_term: 1 leader_uuid: "aaea37fa8f5a479c92344445befbe98f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aaea37fa8f5a479c92344445befbe98f" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46177 } health_report { overall_health: HEALTHY } } }
W20260811 02:32:52.537261 30666 tablet.cc:2369] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:52.555045 30807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.552723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51144 (local address 127.17.79.2:46177)
0811 02:32:52.552804 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:52.552805 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:52.552850 (+ 45us) server_negotiation.cc:407] Connection header received
0811 02:32:52.552919 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:52.552920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:52.552933 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:52.552976 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:52.553174 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.553657 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.554459 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:52.554643 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:52.554701 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:52.554830 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:52.554857 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:52.554895 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:52.554965 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 02:32:52.554984 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 02:32:52.556162 30578 raft_consensus.cc:1261] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Refusing update from remote peer aaea37fa8f5a479c92344445befbe98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:52.556217 30119 raft_consensus.cc:1261] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1 [term 1 FOLLOWER]: Refusing update from remote peer aaea37fa8f5a479c92344445befbe98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:52.556519 30828 consensus_queue.cc:1035] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4e7f4fd08f4532971f0894ce157ae1" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:52.556670 30827 consensus_queue.cc:1035] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8192f9fdf5374c61b0dea22e91955b04" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:52.557305 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.557154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:41285)
0811 02:32:52.557219 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.557266 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 02:32:52.557721 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.557626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:48305)
0811 02:32:52.557666 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.557691 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 02:32:52.558558 30838 mvcc.cc:205] Tried to move back new op lower bound from 7317158185187946496 to 7317158184979308544. Current Snapshot: MvccSnapshot[applied={T|T < 7317158185187946496}]
I20260811 02:32:52.558938 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.558842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.2:33683)
0811 02:32:52.558882 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.558908 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 02:32:52.558970 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.558874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.1:46835)
0811 02:32:52.558916 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.558942 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 02:32:52.559141 30843 mvcc.cc:205] Tried to move back new op lower bound from 7317158185187946496 to 7317158184979308544. Current Snapshot: MvccSnapshot[applied={T|T < 7317158185187946496 or (T in {7317158185187946496})}]
I20260811 02:32:52.559412 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.559312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:37437 (local address 127.17.79.3:43343)
0811 02:32:52.559354 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.559379 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 02:32:52.561369 29565 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:52.561452 29565 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:52.562894 29565 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f861d17c2a2243f0b40dc95346b35d87: Sending DeleteTablet for 3 replicas of tablet 2bdecc2a32124cf6b244dec47bc5c2b1
I20260811 02:32:52.563211 30552 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bdecc2a32124cf6b244dec47bc5c2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:52 UTC) from {username='oryx', principal='oryx/127.17.79.61@KRBTEST.COM'} at 127.0.0.1:46658
I20260811 02:32:52.563267 30313 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bdecc2a32124cf6b244dec47bc5c2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:52 UTC) from {username='oryx', principal='oryx/127.17.79.61@KRBTEST.COM'} at 127.0.0.1:51142
I20260811 02:32:52.563402 30086 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bdecc2a32124cf6b244dec47bc5c2b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:52 UTC) from {username='oryx', principal='oryx/127.17.79.61@KRBTEST.COM'} at 127.0.0.1:52978
I20260811 02:32:52.563444 30851 tablet_replica.cc:330] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: stopping tablet replica
I20260811 02:32:52.563498 30851 raft_consensus.cc:2229] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:52.563437 30850 tablet_replica.cc:330] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: stopping tablet replica
I20260811 02:32:52.563555 30851 raft_consensus.cc:2258] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:52.563598 30850 raft_consensus.cc:2229] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:52.563813 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 29816
I20260811 02:32:52.563843 30852 tablet_replica.cc:330] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 9c4e7f4fd08f4532971f0894ce157ae1: stopping tablet replica
I20260811 02:32:52.563932 30850 raft_consensus.cc:2258] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:52.564174 30851 ts_tablet_manager.cc:1905] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:52.564347 30850 ts_tablet_manager.cc:1905] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:52.565719 30851 ts_tablet_manager.cc:1918] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:52.565770 30851 log.cc:1196] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/2bdecc2a32124cf6b244dec47bc5c2b1
I20260811 02:32:52.565999 30851 ts_tablet_manager.cc:1939] T 2bdecc2a32124cf6b244dec47bc5c2b1 P aaea37fa8f5a479c92344445befbe98f: Deleting consensus metadata
I20260811 02:32:52.566341 29547 catalog_manager.cc:4841] TS aaea37fa8f5a479c92344445befbe98f (127.17.79.2:46177): tablet 2bdecc2a32124cf6b244dec47bc5c2b1 (table test-table [id=c65e52e8609546c7be0d1bdd0613bd47]) successfully deleted
I20260811 02:32:52.566768 30850 ts_tablet_manager.cc:1918] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:52.566848 30850 log.cc:1196] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/2bdecc2a32124cf6b244dec47bc5c2b1
I20260811 02:32:52.567104 30850 ts_tablet_manager.cc:1939] T 2bdecc2a32124cf6b244dec47bc5c2b1 P 8192f9fdf5374c61b0dea22e91955b04: Deleting consensus metadata
I20260811 02:32:52.567452 29547 catalog_manager.cc:4841] TS 8192f9fdf5374c61b0dea22e91955b04 (127.17.79.3:37149): tablet 2bdecc2a32124cf6b244dec47bc5c2b1 (table test-table [id=c65e52e8609546c7be0d1bdd0613bd47]) successfully deleted
I20260811 02:32:52.578647 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 30208
I20260811 02:32:52.578671 30799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:52.578536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37027 (local address 127.0.0.1:52984)
0811 02:32:52.578594 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:52.578624 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:37027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 02:32:52.578958 29547 catalog_manager.cc:4584] TS 9c4e7f4fd08f4532971f0894ce157ae1 (127.17.79.1:37027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2bdecc2a32124cf6b244dec47bc5c2b1: Network error: Client connection negotiation failed: client connection to 127.17.79.1:37027: connect: Connection refused (error 111)
I20260811 02:32:52.598771 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 30441
I20260811 02:32:52.610721 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 29340
I20260811 02:32:52.624358 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 29655
2026-08-11T02:32:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6714 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:52 dist-test-slave-7nm7 krb5kdc[30855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:52 dist-test-slave-7nm7 krb5kdc[30855](info): set up 2 sockets
Aug 11 02:32:52 dist-test-slave-7nm7 krb5kdc[30855](info): commencing operation
krb5kdc: starting...
W20260811 02:32:53.953940 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:54Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab.
Entry for principal oryx/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab.
I20260811 02:32:54.078516 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36631
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab
--principal=oryx/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:34713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:36631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:54.162847 30873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:54.163070 30873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:54.163093 30873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:54.164276 30873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:54.164320 30873 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 02:32:54.164335 30873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:54.164347 30873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:54.164359 30873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:54.164415 30873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:54.165977 30873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:36631
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.62.keytab
--principal=oryx/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:54.166306 30873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:54.166569 30873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:54.171700 30886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:54.171677 30882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:54.171687 30881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:54.171705 30873 server_base.cc:1034] running on GCE node
I20260811 02:32:54.172251 30873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:54.172597 30873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:54.173768 30873 hybrid_clock.cc:648] HybridClock initialized: now 1786415574173745 us; error 38 us; skew 500 ppm
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:54.176524 30873 init.cc:377] Logged in from keytab as oryx/127.17.79.62@KRBTEST.COM (short username oryx)
I20260811 02:32:54.177016 30873 webserver.cc:460] Webserver started at http://127.17.79.62:46145/ using document root <none> and password file <none>
I20260811 02:32:54.177259 30873 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:54.177309 30873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:54.177448 30873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:54.178623 30873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "9dba008e4635449a8f6a575231313d6a"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "d4bb509263d3dac0c9baf3606b099ee4"
server_key_iv: "c06394638d55ffcd21c1a70bbc697cc7"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.178992 30873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "9dba008e4635449a8f6a575231313d6a"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "d4bb509263d3dac0c9baf3606b099ee4"
server_key_iv: "c06394638d55ffcd21c1a70bbc697cc7"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.180491 30873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:32:54.181286 30899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.181520 30873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:54.181643 30873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "9dba008e4635449a8f6a575231313d6a"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "d4bb509263d3dac0c9baf3606b099ee4"
server_key_iv: "c06394638d55ffcd21c1a70bbc697cc7"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.181723 30873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:54.199121 30873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:54.201495 30873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:54.201676 30873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:54.206820 30873 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:36631
I20260811 02:32:54.206871 31003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:36631 every 8 connection(s)
I20260811 02:32:54.207228 30873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:54.207923 31004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:54.210165 31004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Bootstrap starting.
I20260811 02:32:54.210819 31004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:54.211066 31004 log.cc:824] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:54.211745 31004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: No bootstrap required, opened a new log
I20260811 02:32:54.213734 31004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba008e4635449a8f6a575231313d6a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36631 } }
I20260811 02:32:54.213872 31004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:54.213924 31004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dba008e4635449a8f6a575231313d6a, State: Initialized, Role: FOLLOWER
I20260811 02:32:54.214089 31004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba008e4635449a8f6a575231313d6a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36631 } }
I20260811 02:32:54.214126 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 30873
I20260811 02:32:54.214178 31004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:54.214217 31004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:54.214224 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:54.214299 31004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:54.214469 17724 external_mini_cluster.cc:1428] Setting key fe917ab849f9f0eae390d94a4123b4ce
I20260811 02:32:54.215041 31004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba008e4635449a8f6a575231313d6a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36631 } }
I20260811 02:32:54.215234 31004 leader_election.cc:302] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dba008e4635449a8f6a575231313d6a; no voters:
I20260811 02:32:54.215430 31004 leader_election.cc:288] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:54.215461 31018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:54.215653 31018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [term 1 LEADER]: Becoming Leader. State: Replica: 9dba008e4635449a8f6a575231313d6a, State: Running, Role: LEADER
I20260811 02:32:54.215742 31004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:54.215746 31018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba008e4635449a8f6a575231313d6a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36631 } }
I20260811 02:32:54.216145 31018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dba008e4635449a8f6a575231313d6a. Latest consensus state: current_term: 1 leader_uuid: "9dba008e4635449a8f6a575231313d6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba008e4635449a8f6a575231313d6a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36631 } } }
I20260811 02:32:54.216218 31018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:54.216466 31020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dba008e4635449a8f6a575231313d6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba008e4635449a8f6a575231313d6a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36631 } } }
I20260811 02:32:54.216566 31020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a [sys.catalog]: This master's current role is: LEADER
W20260811 02:32:54.217751 31050 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:32:54.217809 31050 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:32:54.217901 31025 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:54.218098 31025 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:54.219627 31025 catalog_manager.cc:1347] Generated new cluster ID: dfd418f3d32f433f9334b4fea214f19c
I20260811 02:32:54.219688 31025 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:54.227316 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.215000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35194 (local address 127.17.79.62:36631)
0811 02:32:54.215186 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.215195 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.215230 (+ 35us) server_negotiation.cc:407] Connection header received
0811 02:32:54.215318 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.215323 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.215390 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.215537 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.216771 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.218096 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.219185 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.219687 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.219837 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.222644 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.222649 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.222649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.222661 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.225498 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.225908 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.225912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.225912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.226066 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.226322 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.226324 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.226324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.226648 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.226804 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.226958 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.227099 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":105,"threads_started":1}
I20260811 02:32:54.238690 31025 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:54.239341 31025 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:54.244017 31025 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Generated new TSK 0
I20260811 02:32:54.244231 31025 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab.
Entry for principal oryx/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab.
I20260811 02:32:54.273176 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36631
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab
--principal=oryx/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:34713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:54.373611 31062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:54.373937 31062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:54.373986 31062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:54.375263 31062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:54.375311 31062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:54.375332 31062 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:54.375351 31062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:54.376933 31062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab
--principal=oryx/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:36631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:54.377207 31062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:54.377455 31062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:54.383299 31070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:54.383410 31062 server_base.cc:1034] running on GCE node
W20260811 02:32:54.383311 31072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:54.383311 31069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:54.383742 31062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:54.384003 31062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:54.385257 31062 hybrid_clock.cc:648] HybridClock initialized: now 1786415574385196 us; error 80 us; skew 500 ppm
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:54.388077 31062 init.cc:377] Logged in from keytab as oryx/127.17.79.1@KRBTEST.COM (short username oryx)
I20260811 02:32:54.388556 31062 webserver.cc:460] Webserver started at http://127.17.79.1:35745/ using document root <none> and password file <none>
I20260811 02:32:54.388782 31062 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:54.388831 31062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:54.388953 31062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:54.390105 31062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "59332b5d9d0b41e1aad085ca6c24dd86"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "540a5a5943f5767e9c66672399249523"
server_key_iv: "f73d124ca468e8b137e2378ea9de6f9d"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.390522 31062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "59332b5d9d0b41e1aad085ca6c24dd86"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "540a5a5943f5767e9c66672399249523"
server_key_iv: "f73d124ca468e8b137e2378ea9de6f9d"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.391856 31062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:54.392729 31082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.393015 31062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:54.393098 31062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "59332b5d9d0b41e1aad085ca6c24dd86"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "540a5a5943f5767e9c66672399249523"
server_key_iv: "f73d124ca468e8b137e2378ea9de6f9d"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.393200 31062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:54.413172 31062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:54.415596 31062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:54.415772 31062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:54.416576 31062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:54.416627 31062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.416662 31062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:54.416682 31062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:54.424611 31062 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:36227
I20260811 02:32:54.424692 31268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:36227 every 8 connection(s)
I20260811 02:32:54.425014 31062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:54.427589 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.416996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:34799 (local address 127.17.79.62:36631)
0811 02:32:54.417068 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.417071 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.417390 (+ 319us) server_negotiation.cc:407] Connection header received
0811 02:32:54.418174 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.418175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.418192 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.418322 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.419275 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.419894 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.421631 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.421982 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.422066 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.424846 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.424847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.424847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.424859 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.426348 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.426744 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.426745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.426745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.426798 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.426980 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.426980 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.426981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.427083 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.427134 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.427450 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.427524 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 02:32:54.427747 31099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.416989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36631 (local address 127.17.79.1:34799)
0811 02:32:54.417203 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.417257 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.418025 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.418416 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.418422 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.418841 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:54.419163 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.419172 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.420001 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.420003 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.421521 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.421525 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.422100 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.422102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.422276 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.422862 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:54.422871 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:54.424710 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:54.426424 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.426431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.426433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.426670 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.426843 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.426843 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.426843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.426931 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.427167 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:54.427174 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:54.427315 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.427412 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.427540 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":135,"threads_started":1}
I20260811 02:32:54.428285 31269 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36631
I20260811 02:32:54.428401 31269 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:54.428578 31269 heartbeater.cc:511] Master 127.17.79.62:36631 requested a full tablet report, sending...
I20260811 02:32:54.429169 30930 ts_manager.cc:194] Registered new tserver with Master: 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227)
I20260811 02:32:54.429700 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 31062
I20260811 02:32:54.429837 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:54.430050 17724 external_mini_cluster.cc:1428] Setting key 7e20707369df5c54b64c4d09b30ebf09
I20260811 02:32:54.430058 30930 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:34799
I20260811 02:32:54.435901 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.429500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:46419 (local address 127.17.79.62:36631)
0811 02:32:54.430260 (+ 760us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.430262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.430273 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:54.430297 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.430297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.430309 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.430364 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.430820 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.431303 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.432011 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.432220 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.432301 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.433251 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.433253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.433253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.433260 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.434706 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.435082 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.435083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.435084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.435151 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.435361 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.435362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.435362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.435477 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.435554 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.435717 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.435801 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718}
I20260811 02:32:54.435914 31279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.429409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36631 (local address 127.17.79.1:46419)
0811 02:32:54.429595 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.429606 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.429658 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.430427 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.430429 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.430649 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:54.430717 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.430719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.431411 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.431412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.431923 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.431925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.432299 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.432300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.432367 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.432848 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:54.432853 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:54.433143 (+ 290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:54.434810 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.434812 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.434812 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.434993 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.435229 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.435230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.435231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.435297 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.435547 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:54.435547 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:54.435596 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.435690 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.435801 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for oryx/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab.
Entry for principal oryx/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab.
I20260811 02:32:54.459503 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36631
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab
--principal=oryx/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:34713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:54.544268 31283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:54.544517 31283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:54.544560 31283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:54.545804 31283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:54.545877 31283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:54.545914 31283 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:54.545953 31283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:54.547533 31283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab
--principal=oryx/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:36631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:54.547824 31283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:54.548079 31283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:54.553606 31297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:54.553602 31294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:54.553824 31283 server_base.cc:1034] running on GCE node
W20260811 02:32:54.553601 31295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:54.554209 31283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:54.554500 31283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:54.555651 31283 hybrid_clock.cc:648] HybridClock initialized: now 1786415574555641 us; error 36 us; skew 500 ppm
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:54.558378 31283 init.cc:377] Logged in from keytab as oryx/127.17.79.2@KRBTEST.COM (short username oryx)
I20260811 02:32:54.558809 31283 webserver.cc:460] Webserver started at http://127.17.79.2:44643/ using document root <none> and password file <none>
I20260811 02:32:54.559064 31283 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:54.559146 31283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:54.559296 31283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:54.560360 31283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "5dfd08364e221d96394541774c91bb2e"
server_key_iv: "b1dbe797d62f4d179cabe522d665e47b"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.560717 31283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "5dfd08364e221d96394541774c91bb2e"
server_key_iv: "b1dbe797d62f4d179cabe522d665e47b"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.562125 31283 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:54.562922 31308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.563118 31283 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:54.563232 31283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "5dfd08364e221d96394541774c91bb2e"
server_key_iv: "b1dbe797d62f4d179cabe522d665e47b"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.563321 31283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:54.571552 31283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:54.573974 31283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:54.574283 31283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:54.574851 31283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:54.574918 31283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.574965 31283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:54.574993 31283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.582337 31283 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:45507
I20260811 02:32:54.582391 31500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:45507 every 8 connection(s)
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:54.582772 31283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:54.585556 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 31283
I20260811 02:32:54.585721 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:54.586134 17724 external_mini_cluster.cc:1428] Setting key 77d7221c640837bc136f6b5d66bb9104
I20260811 02:32:54.587584 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.575515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:47379 (local address 127.17.79.62:36631)
0811 02:32:54.575594 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.575596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.575823 (+ 227us) server_negotiation.cc:407] Connection header received
0811 02:32:54.576310 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.576312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.576325 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.576404 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.577294 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.578181 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.579425 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.579783 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.579867 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.583522 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.583524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.583524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.583532 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.585580 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.586360 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.586362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.586362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.586452 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.586770 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.586771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.586772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.586919 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.587019 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.587427 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.587508 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:32:54.587874 31321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.575485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36631 (local address 127.17.79.2:47379)
0811 02:32:54.575683 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.575726 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.576215 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.576504 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.576508 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.576892 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:54.577171 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.577178 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.578313 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.578314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.579325 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.579328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.579895 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.579897 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.580038 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.581210 (+ 1172us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:54.581241 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:54.583262 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:54.585844 (+ 2582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.585852 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.585854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.586182 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.586542 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.586543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.586544 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.586696 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.587040 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:54.587065 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:54.587246 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.587384 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.587578 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":115,"threads_started":1}
I20260811 02:32:54.588703 31501 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36631
I20260811 02:32:54.588837 31501 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:54.589059 31501 heartbeater.cc:511] Master 127.17.79.62:36631 requested a full tablet report, sending...
I20260811 02:32:54.589466 30930 ts_manager.cc:194] Registered new tserver with Master: 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507)
I20260811 02:32:54.589911 30930 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:47379
WARNING: no policy specified for oryx/127.17.79.3@KRBTEST.COM; defaulting to no policy
I20260811 02:32:54.596483 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.590327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:47791 (local address 127.17.79.62:36631)
0811 02:32:54.590725 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.590726 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.590734 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:32:54.590751 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.590752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.590761 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.590811 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.591150 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.591706 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.592442 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.592632 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.592749 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.593717 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.593719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.593719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.593726 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.595200 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.595571 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.595572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.595573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.595629 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.595891 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.595892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.595892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.596042 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.596172 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.596341 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.596422 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378}
I20260811 02:32:54.596774 31512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.590217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36631 (local address 127.17.79.2:47791)
0811 02:32:54.590395 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.590407 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.590459 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.590830 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.590831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.591009 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:54.591060 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.591061 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.591800 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.591801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.592373 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.592375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.592750 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.592750 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.592815 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.593305 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:54.593311 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:54.593600 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:54.595293 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.595294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.595295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.595494 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.595714 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.595715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.595716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.595815 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.596165 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:54.596166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:54.596214 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.596580 (+ 366us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.596705 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":124,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab.
Entry for principal oryx/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab.
I20260811 02:32:54.613695 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36631
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab
--principal=oryx/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:34713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:54.695623 31520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:54.695856 31520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:54.695899 31520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:54.697146 31520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:54.697211 31520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:54.697248 31520 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 02:32:54.697305 31520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:54.698886 31520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab
--principal=oryx/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.79.62:36631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:54.699146 31520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:54.699373 31520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:54.704517 31534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:54.704619 31537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:54.704767 31539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:54.704663 31520 server_base.cc:1034] running on GCE node
I20260811 02:32:54.704972 31520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:54.705226 31520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:54.706404 31520 hybrid_clock.cc:648] HybridClock initialized: now 1786415574706387 us; error 28 us; skew 500 ppm
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:54.709049 31520 init.cc:377] Logged in from keytab as oryx/127.17.79.3@KRBTEST.COM (short username oryx)
I20260811 02:32:54.709517 31520 webserver.cc:460] Webserver started at http://127.17.79.3:45067/ using document root <none> and password file <none>
I20260811 02:32:54.709743 31520 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:54.709786 31520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:54.709944 31520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:54.711063 31520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "a013edd19de34e5eaaa65723b74424ed"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "970b5b04a8f8850582f0ed63a308f7c2"
server_key_iv: "04a03aab9b916f1596f2fc35151557a4"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.711433 31520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "a013edd19de34e5eaaa65723b74424ed"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "970b5b04a8f8850582f0ed63a308f7c2"
server_key_iv: "04a03aab9b916f1596f2fc35151557a4"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.712841 31520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:32:54.713668 31550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.713863 31520 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:54.713979 31520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "a013edd19de34e5eaaa65723b74424ed"
format_stamp: "Formatted at 2026-08-11 02:32:54 on dist-test-slave-7nm7"
server_key: "970b5b04a8f8850582f0ed63a308f7c2"
server_key_iv: "04a03aab9b916f1596f2fc35151557a4"
server_key_version: "encryptionkey@0"
I20260811 02:32:54.714053 31520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:54.728689 31520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:54.730811 31520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:54.730980 31520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:54.731513 31520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:54.731582 31520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.731628 31520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:54.731654 31520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:54.739221 31520 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:37553
I20260811 02:32:54.739573 31520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:54.739300 31764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:37553 every 8 connection(s)
I20260811 02:32:54.741855 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.731960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:45787 (local address 127.17.79.62:36631)
0811 02:32:54.732036 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.732039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.732253 (+ 214us) server_negotiation.cc:407] Connection header received
0811 02:32:54.732720 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.732722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.732736 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.732822 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.733901 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.734785 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.735799 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.736013 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.736099 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.739055 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.739057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.739058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.739067 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.740625 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.741003 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.741004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.741004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.741054 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.741325 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.741326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.741326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.741425 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.741475 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.741719 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.741783 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:32:54.741993 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.731950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36631 (local address 127.17.79.3:45787)
0811 02:32:54.732111 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.732150 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.732624 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.732888 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.732892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.733466 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:54.733786 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.733794 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.734886 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.734887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.735702 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.735704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.736112 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.736113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.736239 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.736763 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:54.736771 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:54.738939 (+ 2168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:54.740714 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.740720 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.740721 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.740933 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.741139 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.741140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.741141 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.741254 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.741482 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:54.741487 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:54.741596 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.741686 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.741807 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260811 02:32:54.742499 31765 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36631
I20260811 02:32:54.742601 31765 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:54.742777 31765 heartbeater.cc:511] Master 127.17.79.62:36631 requested a full tablet report, sending...
I20260811 02:32:54.743207 30933 ts_manager.cc:194] Registered new tserver with Master: a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553)
I20260811 02:32:54.743701 30933 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:45787
I20260811 02:32:54.748977 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.743576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:57483 (local address 127.17.79.62:36631)
0811 02:32:54.743615 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.743617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.743734 (+ 117us) server_negotiation.cc:407] Connection header received
0811 02:32:54.743776 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.743777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.743787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.743837 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.744312 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.744890 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.745542 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.745720 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.745777 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.746774 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.746776 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.746776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.746782 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.748143 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.748437 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.748437 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.748438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.748487 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.748641 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.748641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.748641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.748724 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.748769 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.748871 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.748924 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:32:54.748986 31784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.743517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36631 (local address 127.17.79.3:57483)
0811 02:32:54.743646 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.743657 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.743726 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.743962 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.743963 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.744174 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:54.744230 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.744231 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.744979 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.744980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.745470 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.745472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.745790 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.745791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.745835 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.746416 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:54.746421 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:54.746693 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:54.748221 (+ 1528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.748221 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.748222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.748372 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.748545 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:54.748546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:54.748546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:54.748594 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:54.748774 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:54.748775 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:54.748808 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.748858 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.748928 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260811 02:32:54.749742 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 31520
I20260811 02:32:54.749845 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:54.750066 17724 external_mini_cluster.cc:1428] Setting key bd21712e82d2af2fa8dac7498922dde8
I20260811 02:32:54.750953 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 02:32:54.774147 31016 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:54.768846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35206 (local address 127.17.79.62:36631)
0811 02:32:54.768909 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.768911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.768920 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:54.768944 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.768945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.768955 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.769013 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.769558 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.770039 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.770801 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.770979 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.771033 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.774054 (+ 3021us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35206: BlockingRecv error: recv got EOF from 127.0.0.1:35206 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 11 02:32:54 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:54.781797 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.774910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35216 (local address 127.17.79.62:36631)
0811 02:32:54.774965 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.774967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.775068 (+ 101us) server_negotiation.cc:407] Connection header received
0811 02:32:54.775114 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.775114 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.775122 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.775170 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:54.775583 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.776021 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.776625 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.776801 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.776852 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.779193 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:54.779195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:54.779195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:54.779202 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:54.780698 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.781051 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.781052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.781053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.781119 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:54.781352 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:54.781352 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:54.781352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:54.781450 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:54.781524 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.781644 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.781702 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 02:32:54.783636 30933 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:54.785898 30933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:54.793848 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.788639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:45507 (local address 127.0.0.1:43184)
0811 02:32:54.789490 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.789499 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.789538 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.790075 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.790076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.790078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:54.790126 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.790127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.791380 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.791381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.792497 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.792499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.793532 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.793532 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.793619 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.793645 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.793702 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.793765 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"mutex_wait_us":21,"thread_start_us":104,"threads_started":1}
I20260811 02:32:54.793881 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.788897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41018 (local address 127.17.79.1:36227)
0811 02:32:54.789343 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.789348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.789361 (+ 13us) server_negotiation.cc:407] Connection header received
0811 02:32:54.789464 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.789466 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.789485 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.789564 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:54.789840 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.791038 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.792601 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.793342 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.793414 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.793491 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.793750 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.793784 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":91,"threads_started":1}
I20260811 02:32:54.794128 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.788911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43184 (local address 127.17.79.2:45507)
0811 02:32:54.789840 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.789845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.789855 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:54.789927 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.789929 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.789944 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.790015 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:54.790207 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.791287 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.792600 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.793342 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.793414 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.793491 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.793976 (+ 485us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.794021 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":71,"threads_started":1}
I20260811 02:32:54.794199 31811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.788591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:36227 (local address 127.0.0.1:41018)
0811 02:32:54.789248 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.789296 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.789371 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.789655 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.789657 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.789659 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:54.789728 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.789730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.791175 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.791177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.792496 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.792499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.793530 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.793532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.793619 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.793632 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.793702 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.794108 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"mutex_wait_us":357,"thread_start_us":50,"threads_started":1}
I20260811 02:32:54.794806 31401 tablet_service.cc:1467] Processing CreateTablet for tablet a088c7b1f8794c3ebcf5bc207537b9fa (DEFAULT_TABLE table=test-table [id=c38da358d97a455ca47f3f3f6cbdd0f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:54.794808 31164 tablet_service.cc:1467] Processing CreateTablet for tablet a088c7b1f8794c3ebcf5bc207537b9fa (DEFAULT_TABLE table=test-table [id=c38da358d97a455ca47f3f3f6cbdd0f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:54.795199 31401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a088c7b1f8794c3ebcf5bc207537b9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:54.795199 31164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a088c7b1f8794c3ebcf5bc207537b9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:54.796281 31808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.788640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37553 (local address 127.0.0.1:35144)
0811 02:32:54.790620 (+ 1980us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.790632 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.790727 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.790993 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.790994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.790996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:54.791045 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.791047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.792933 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.792934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.795047 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.795050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.796013 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.796014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.796094 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.796099 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.796163 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.796204 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1966,"thread_start_us":95,"threads_started":1}
I20260811 02:32:54.796310 31821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.789159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35144 (local address 127.17.79.3:37553)
0811 02:32:54.789791 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.789795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.790695 (+ 900us) server_negotiation.cc:407] Connection header received
0811 02:32:54.790824 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.790828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.790845 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.790899 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:54.791141 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.792815 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.795123 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.795926 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.796000 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.796078 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.796177 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.796215 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":131,"threads_started":1}
I20260811 02:32:54.797349 31646 tablet_service.cc:1467] Processing CreateTablet for tablet a088c7b1f8794c3ebcf5bc207537b9fa (DEFAULT_TABLE table=test-table [id=c38da358d97a455ca47f3f3f6cbdd0f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:54.797706 31646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a088c7b1f8794c3ebcf5bc207537b9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:54.799108 31824 tablet_bootstrap.cc:492] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Bootstrap starting.
I20260811 02:32:54.799786 31824 tablet_bootstrap.cc:654] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:54.800160 31824 log.cc:824] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:54.801251 31826 tablet_bootstrap.cc:492] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Bootstrap starting.
I20260811 02:32:54.801786 31824 tablet_bootstrap.cc:492] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: No bootstrap required, opened a new log
I20260811 02:32:54.801858 31824 ts_tablet_manager.cc:1397] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:54.802440 31827 tablet_bootstrap.cc:492] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Bootstrap starting.
I20260811 02:32:54.803069 31827 tablet_bootstrap.cc:654] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:54.803400 31827 log.cc:824] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:54.804142 31827 tablet_bootstrap.cc:492] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: No bootstrap required, opened a new log
I20260811 02:32:54.804212 31827 ts_tablet_manager.cc:1397] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:54.804111 31824 raft_consensus.cc:348] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.804322 31824 raft_consensus.cc:374] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:54.804359 31824 raft_consensus.cc:729] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca18e7f671f4868b5ad22bb4e3f11d9, State: Initialized, Role: FOLLOWER
I20260811 02:32:54.804502 31824 consensus_queue.cc:260] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.804801 31824 ts_tablet_manager.cc:1428] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:54.804994 31501 heartbeater.cc:503] Master 127.17.79.62:36631 was elected leader, sending a full tablet report...
I20260811 02:32:54.805429 31826 tablet_bootstrap.cc:654] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:54.805750 31826 log.cc:824] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:54.806602 31826 tablet_bootstrap.cc:492] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: No bootstrap required, opened a new log
I20260811 02:32:54.806506 31827 raft_consensus.cc:348] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.806674 31826 ts_tablet_manager.cc:1397] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 02:32:54.806674 31827 raft_consensus.cc:374] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:54.806710 31827 raft_consensus.cc:729] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59332b5d9d0b41e1aad085ca6c24dd86, State: Initialized, Role: FOLLOWER
I20260811 02:32:54.806830 31827 consensus_queue.cc:260] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.807089 31827 ts_tablet_manager.cc:1428] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:32:54.807137 31269 heartbeater.cc:503] Master 127.17.79.62:36631 was elected leader, sending a full tablet report...
I20260811 02:32:54.808202 31826 raft_consensus.cc:348] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.808319 31826 raft_consensus.cc:374] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:54.808341 31826 raft_consensus.cc:729] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Initialized, Role: FOLLOWER
I20260811 02:32:54.808455 31826 consensus_queue.cc:260] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.808715 31826 ts_tablet_manager.cc:1428] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:32:54.808795 31765 heartbeater.cc:503] Master 127.17.79.62:36631 was elected leader, sending a full tablet report...
W20260811 02:32:54.833420 31503 tablet.cc:2369] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:54.901995 31835 raft_consensus.cc:482] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:54.902125 31835 raft_consensus.cc:504] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.902593 31835 leader_election.cc:288] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507)
I20260811 02:32:54.906675 31814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.902904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:43677 (local address 127.17.79.2:45507)
0811 02:32:54.902966 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.902968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.903162 (+ 194us) server_negotiation.cc:407] Connection header received
0811 02:32:54.903190 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.903191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.903201 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.903376 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:54.903510 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.904192 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.905705 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.906287 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.906366 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.906377 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.906563 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.906603 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:32:54.906675 31815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.902856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:42167 (local address 127.17.79.1:36227)
0811 02:32:54.902910 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.902913 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.902925 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:54.902992 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.902993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.903005 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.903069 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:54.903365 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.904135 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.905705 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.906288 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.906366 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.906377 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.906563 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.906603 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:32:54.906701 31836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.902829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:45507 (local address 127.17.79.3:43677)
0811 02:32:54.903043 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.903072 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.903130 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.903383 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.903384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.903385 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:54.903443 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.903444 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.904295 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.904296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.905604 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.905607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.906378 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.906379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.906475 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.906482 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.906545 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.906596 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":15,"thread_start_us":127,"threads_started":1}
I20260811 02:32:54.906705 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.902802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:36227 (local address 127.17.79.3:42167)
0811 02:32:54.902866 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:54.902878 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:54.902925 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:54.903100 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:54.903101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:54.903103 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:54.903193 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.903194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.904295 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.904296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.905604 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:54.905607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.906378 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.906379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:54.906475 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.906482 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 02:32:54.906545 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 02:32:54.906594 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":72}
I20260811 02:32:54.907119 31427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a088c7b1f8794c3ebcf5bc207537b9fa" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" is_pre_election: true
I20260811 02:32:54.907294 31427 raft_consensus.cc:2454] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 0.
I20260811 02:32:54.907275 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a088c7b1f8794c3ebcf5bc207537b9fa" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" is_pre_election: true
I20260811 02:32:54.907418 31193 raft_consensus.cc:2454] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 0.
I20260811 02:32:54.907531 31551 leader_election.cc:302] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca18e7f671f4868b5ad22bb4e3f11d9, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:54.907708 31835 raft_consensus.cc:2781] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:54.907764 31835 raft_consensus.cc:482] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:54.907784 31835 raft_consensus.cc:3037] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:54.908783 31835 raft_consensus.cc:504] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.908932 31835 leader_election.cc:288] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 election: Requested vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507)
I20260811 02:32:54.909107 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a088c7b1f8794c3ebcf5bc207537b9fa" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86"
I20260811 02:32:54.909140 31427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a088c7b1f8794c3ebcf5bc207537b9fa" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9"
I20260811 02:32:54.909217 31427 raft_consensus.cc:3037] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:54.909222 31193 raft_consensus.cc:3037] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:54.909912 31427 raft_consensus.cc:2454] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 1.
I20260811 02:32:54.910115 31193 raft_consensus.cc:2454] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 1.
I20260811 02:32:54.910105 31551 leader_election.cc:302] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca18e7f671f4868b5ad22bb4e3f11d9, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:54.910203 31835 raft_consensus.cc:2781] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:54.910387 31835 raft_consensus.cc:686] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 1 LEADER]: Becoming Leader. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Running, Role: LEADER
I20260811 02:32:54.910467 31835 consensus_queue.cc:237] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.911369 30933 catalog_manager.cc:5495] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed reported cstate change: term changed from 0 to 1, leader changed from <none> to a013edd19de34e5eaaa65723b74424ed (127.17.79.3). New cstate: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } health_report { overall_health: HEALTHY } } }
W20260811 02:32:54.925913 31271 tablet.cc:2369] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:54.939445 31821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:54.936398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35156 (local address 127.17.79.3:37553)
0811 02:32:54.936462 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:54.936465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:54.936474 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:54.936518 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:54.936519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:54.936539 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:54.936604 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:54.936729 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.937195 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.938440 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:54.938637 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:54.938702 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:54.938870 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:54.938976 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:54.939052 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:54.939199 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 02:32:54.939220 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:32:54.941551 31193 raft_consensus.cc:1261] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Refusing update from remote peer a013edd19de34e5eaaa65723b74424ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:54.941624 31427 raft_consensus.cc:1261] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Refusing update from remote peer a013edd19de34e5eaaa65723b74424ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:54.941977 31837 consensus_queue.cc:1035] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:54.942106 31835 consensus_queue.cc:1035] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:54.944286 31843 mvcc.cc:205] Tried to move back new op lower bound from 7317158194957709312 to 7317158194834055168. Current Snapshot: MvccSnapshot[applied={T|T < 7317158194957709312}]
I20260811 02:32:54.944939 31845 mvcc.cc:205] Tried to move back new op lower bound from 7317158194957709312 to 7317158194834055168. Current Snapshot: MvccSnapshot[applied={T|T < 7317158194957709312}]
I20260811 02:32:54.947461 30933 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:54.947569 30933 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:54.948390 30933 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Sending DeleteTablet for 3 replicas of tablet a088c7b1f8794c3ebcf5bc207537b9fa
I20260811 02:32:54.948769 31164 tablet_service.cc:1514] Processing DeleteTablet for tablet a088c7b1f8794c3ebcf5bc207537b9fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:54 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41018
I20260811 02:32:54.948777 31401 tablet_service.cc:1514] Processing DeleteTablet for tablet a088c7b1f8794c3ebcf5bc207537b9fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:54 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:43184
I20260811 02:32:54.949000 31859 tablet_replica.cc:330] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: stopping tablet replica
I20260811 02:32:54.948982 31646 tablet_service.cc:1514] Processing DeleteTablet for tablet a088c7b1f8794c3ebcf5bc207537b9fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:54 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:35144
I20260811 02:32:54.949105 31859 raft_consensus.cc:2229] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:54.949201 31859 raft_consensus.cc:2258] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:54.949211 31860 tablet_replica.cc:330] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: stopping tablet replica
I20260811 02:32:54.949304 31860 raft_consensus.cc:2229] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:54.949414 31860 raft_consensus.cc:2258] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:54.949714 31859 ts_tablet_manager.cc:1905] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:54.949887 30933 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35216:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:54.950037 30933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:54.950064 31860 ts_tablet_manager.cc:1905] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:54.950711 31861 tablet_replica.cc:330] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: stopping tablet replica
I20260811 02:32:54.950878 31861 raft_consensus.cc:2229] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:54.951057 31861 raft_consensus.cc:2258] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:54.951447 31859 ts_tablet_manager.cc:1918] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:54.951532 31859 log.cc:1196] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/a088c7b1f8794c3ebcf5bc207537b9fa
I20260811 02:32:54.951678 31861 ts_tablet_manager.cc:1905] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:54.951824 31859 ts_tablet_manager.cc:1939] T a088c7b1f8794c3ebcf5bc207537b9fa P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting consensus metadata
I20260811 02:32:54.952200 31401 tablet_service.cc:1467] Processing CreateTablet for tablet 9c613da459d1442a8900300466275d4e (DEFAULT_TABLE table=test-table [id=a41c14c66833476aacab30b17bfb5c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:54.952329 31401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c613da459d1442a8900300466275d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:54.953711 31861 ts_tablet_manager.cc:1918] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:54.953749 31824 tablet_bootstrap.cc:492] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: Bootstrap starting.
I20260811 02:32:54.953889 31861 log.cc:1196] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/a088c7b1f8794c3ebcf5bc207537b9fa
I20260811 02:32:54.953794 31646 tablet_service.cc:1467] Processing CreateTablet for tablet 9c613da459d1442a8900300466275d4e (DEFAULT_TABLE table=test-table [id=a41c14c66833476aacab30b17bfb5c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:54.954134 31646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c613da459d1442a8900300466275d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:54.954195 31824 tablet_bootstrap.cc:654] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:54.954402 31861 ts_tablet_manager.cc:1939] T a088c7b1f8794c3ebcf5bc207537b9fa P a013edd19de34e5eaaa65723b74424ed: Deleting consensus metadata
I20260811 02:32:54.954398 30909 catalog_manager.cc:4841] TS 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227): tablet a088c7b1f8794c3ebcf5bc207537b9fa (table test-table [id=c38da358d97a455ca47f3f3f6cbdd0f1]) successfully deleted
I20260811 02:32:54.954579 31164 tablet_service.cc:1467] Processing CreateTablet for tablet 9c613da459d1442a8900300466275d4e (DEFAULT_TABLE table=test-table [id=a41c14c66833476aacab30b17bfb5c6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:54.954698 31164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c613da459d1442a8900300466275d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:54.955569 31827 tablet_bootstrap.cc:492] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: Bootstrap starting.
I20260811 02:32:54.955952 31827 tablet_bootstrap.cc:654] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:54.956610 31827 tablet_bootstrap.cc:492] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: No bootstrap required, opened a new log
I20260811 02:32:54.956660 31827 ts_tablet_manager.cc:1397] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:54.956950 31826 tablet_bootstrap.cc:492] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Bootstrap starting.
I20260811 02:32:54.957016 31827 raft_consensus.cc:348] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.957101 31827 raft_consensus.cc:374] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:54.957126 31827 raft_consensus.cc:729] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59332b5d9d0b41e1aad085ca6c24dd86, State: Initialized, Role: FOLLOWER
I20260811 02:32:54.957175 31827 consensus_queue.cc:260] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.957304 31827 ts_tablet_manager.cc:1428] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:54.957511 31826 tablet_bootstrap.cc:654] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:54.958613 30906 catalog_manager.cc:4841] TS a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553): tablet a088c7b1f8794c3ebcf5bc207537b9fa (table test-table [id=c38da358d97a455ca47f3f3f6cbdd0f1]) successfully deleted
I20260811 02:32:54.958662 31824 tablet_bootstrap.cc:492] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: No bootstrap required, opened a new log
I20260811 02:32:54.958709 31824 ts_tablet_manager.cc:1397] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 02:32:54.958860 31824 raft_consensus.cc:348] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.958927 31824 raft_consensus.cc:374] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:54.958949 31824 raft_consensus.cc:729] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca18e7f671f4868b5ad22bb4e3f11d9, State: Initialized, Role: FOLLOWER
I20260811 02:32:54.958989 31824 consensus_queue.cc:260] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.959043 31860 ts_tablet_manager.cc:1918] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:54.959108 31824 ts_tablet_manager.cc:1428] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:54.959272 31860 log.cc:1196] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/a088c7b1f8794c3ebcf5bc207537b9fa
I20260811 02:32:54.959522 31826 tablet_bootstrap.cc:492] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: No bootstrap required, opened a new log
I20260811 02:32:54.959570 31826 ts_tablet_manager.cc:1397] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:54.959600 31860 ts_tablet_manager.cc:1939] T a088c7b1f8794c3ebcf5bc207537b9fa P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting consensus metadata
I20260811 02:32:54.959718 31826 raft_consensus.cc:348] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.959784 31826 raft_consensus.cc:374] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:54.959805 31826 raft_consensus.cc:729] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Initialized, Role: FOLLOWER
I20260811 02:32:54.959841 31826 consensus_queue.cc:260] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:54.959924 31826 ts_tablet_manager.cc:1428] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:54.960014 30902 catalog_manager.cc:4841] TS 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507): tablet a088c7b1f8794c3ebcf5bc207537b9fa (table test-table [id=c38da358d97a455ca47f3f3f6cbdd0f1]) successfully deleted
W20260811 02:32:54.990473 31766 tablet.cc:2369] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:32:55.013216 31835 raft_consensus.cc:482] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:55.013334 31835 raft_consensus.cc:504] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.013536 31835 leader_election.cc:288] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507)
I20260811 02:32:55.013743 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c613da459d1442a8900300466275d4e" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" is_pre_election: true
I20260811 02:32:55.013758 31427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c613da459d1442a8900300466275d4e" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" is_pre_election: true
I20260811 02:32:55.013855 31193 raft_consensus.cc:2454] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 0.
I20260811 02:32:55.013871 31427 raft_consensus.cc:2454] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 0.
I20260811 02:32:55.014039 31551 leader_election.cc:302] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca18e7f671f4868b5ad22bb4e3f11d9, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:55.014137 31835 raft_consensus.cc:2781] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:55.014185 31835 raft_consensus.cc:482] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:55.014214 31835 raft_consensus.cc:3037] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.015019 31835 raft_consensus.cc:504] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.015165 31835 leader_election.cc:288] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 election: Requested vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507)
I20260811 02:32:55.015347 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c613da459d1442a8900300466275d4e" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86"
I20260811 02:32:55.015357 31427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c613da459d1442a8900300466275d4e" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9"
I20260811 02:32:55.015453 31427 raft_consensus.cc:3037] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.015435 31193 raft_consensus.cc:3037] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.016225 31427 raft_consensus.cc:2454] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 1.
I20260811 02:32:55.016367 31193 raft_consensus.cc:2454] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 1.
I20260811 02:32:55.016408 31551 leader_election.cc:302] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca18e7f671f4868b5ad22bb4e3f11d9, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:55.016532 31835 raft_consensus.cc:2781] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:55.016594 31835 raft_consensus.cc:686] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 1 LEADER]: Becoming Leader. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Running, Role: LEADER
I20260811 02:32:55.016649 31835 consensus_queue.cc:237] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.017261 30933 catalog_manager.cc:5495] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed reported cstate change: term changed from 0 to 1, leader changed from <none> to a013edd19de34e5eaaa65723b74424ed (127.17.79.3). New cstate: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } health_report { overall_health: HEALTHY } } }
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415574, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.62@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:55.070119 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.063194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35224 (local address 127.17.79.62:36631)
0811 02:32:55.063262 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.063265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.063377 (+ 112us) server_negotiation.cc:407] Connection header received
0811 02:32:55.063410 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.063411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.063423 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.063491 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:55.063928 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.064411 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.065221 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.065410 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.065474 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.067752 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:55.067753 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:55.067753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:55.067759 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:55.069173 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:55.069507 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:55.069508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:55.069508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:55.069556 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:55.069727 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:55.069728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:55.069728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:55.069820 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:55.069868 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.069983 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.070052 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 02:32:55.070282 31881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.063113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36631 (local address 127.0.0.1:35224)
0811 02:32:55.063291 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.063301 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.063366 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.063503 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.063504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.063789 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:55.063848 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.063850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.064502 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.064503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.065111 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.065113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.065484 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.065485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.065525 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.066024 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:55.066028 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:55.067673 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:55.069257 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:55.069264 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:55.069266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:55.069444 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:55.069613 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:55.069614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:55.069614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:55.069672 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:55.069874 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:55.069880 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:55.069918 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.069969 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.070103 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":50,"thread_start_us":95,"threads_started":1}
I20260811 02:32:55.072130 30933 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:35224:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 02:32:55.072365 30933 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:55.073912 31646 tablet_service.cc:1467] Processing CreateTablet for tablet 92f62e29755f40cc9e77a90652e55fac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6309a31401ff44c992e1f256acf23c1a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:55.073927 31401 tablet_service.cc:1467] Processing CreateTablet for tablet 92f62e29755f40cc9e77a90652e55fac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6309a31401ff44c992e1f256acf23c1a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:55.073937 31164 tablet_service.cc:1467] Processing CreateTablet for tablet 92f62e29755f40cc9e77a90652e55fac (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6309a31401ff44c992e1f256acf23c1a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 02:32:55.074086 31401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92f62e29755f40cc9e77a90652e55fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.074085 31646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92f62e29755f40cc9e77a90652e55fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.074111 31164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92f62e29755f40cc9e77a90652e55fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.075466 31827 tablet_bootstrap.cc:492] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: Bootstrap starting.
I20260811 02:32:55.075626 31824 tablet_bootstrap.cc:492] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: Bootstrap starting.
I20260811 02:32:55.075899 31827 tablet_bootstrap.cc:654] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.076012 31824 tablet_bootstrap.cc:654] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.076359 31826 tablet_bootstrap.cc:492] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: Bootstrap starting.
I20260811 02:32:55.076512 31827 tablet_bootstrap.cc:492] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: No bootstrap required, opened a new log
I20260811 02:32:55.076570 31827 ts_tablet_manager.cc:1397] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:55.076673 31826 tablet_bootstrap.cc:654] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.076692 31824 tablet_bootstrap.cc:492] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: No bootstrap required, opened a new log
I20260811 02:32:55.076742 31824 ts_tablet_manager.cc:1397] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:55.076748 31827 raft_consensus.cc:348] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.076826 31827 raft_consensus.cc:374] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.076856 31827 raft_consensus.cc:729] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59332b5d9d0b41e1aad085ca6c24dd86, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.076903 31827 consensus_queue.cc:260] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.076910 31824 raft_consensus.cc:348] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.076997 31824 raft_consensus.cc:374] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.077008 31827 ts_tablet_manager.cc:1428] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:55.077030 31824 raft_consensus.cc:729] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca18e7f671f4868b5ad22bb4e3f11d9, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.077077 31824 consensus_queue.cc:260] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.077133 31833 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.077188 31824 ts_tablet_manager.cc:1428] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:55.077222 31833 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:55.077437 31830 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.077544 31830 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:55.077829 31826 tablet_bootstrap.cc:492] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: No bootstrap required, opened a new log
I20260811 02:32:55.077896 31826 ts_tablet_manager.cc:1397] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:32:55.078019 31826 raft_consensus.cc:348] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.078091 31826 raft_consensus.cc:374] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.078114 31826 raft_consensus.cc:729] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.078166 31826 consensus_queue.cc:260] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.078280 31826 ts_tablet_manager.cc:1428] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:55.078320 31835 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.078413 31835 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:55.208909 31835 raft_consensus.cc:482] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:55.209023 31835 raft_consensus.cc:504] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.209209 31835 leader_election.cc:288] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507)
I20260811 02:32:55.209467 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f62e29755f40cc9e77a90652e55fac" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" is_pre_election: true
I20260811 02:32:55.209522 31427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f62e29755f40cc9e77a90652e55fac" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" is_pre_election: true
I20260811 02:32:55.209585 31193 raft_consensus.cc:2454] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 0.
I20260811 02:32:55.209628 31427 raft_consensus.cc:2454] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 0.
I20260811 02:32:55.209780 31560 leader_election.cc:302] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59332b5d9d0b41e1aad085ca6c24dd86, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:55.209903 31835 raft_consensus.cc:2781] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:55.209949 31835 raft_consensus.cc:482] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:55.209969 31835 raft_consensus.cc:3037] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.210731 31835 raft_consensus.cc:504] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.210875 31835 leader_election.cc:288] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 election: Requested vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507)
I20260811 02:32:55.211022 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f62e29755f40cc9e77a90652e55fac" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86"
I20260811 02:32:55.211102 31193 raft_consensus.cc:3037] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.211068 31427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92f62e29755f40cc9e77a90652e55fac" candidate_uuid: "a013edd19de34e5eaaa65723b74424ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9"
I20260811 02:32:55.211169 31427 raft_consensus.cc:3037] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.211720 31193 raft_consensus.cc:2454] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 1.
I20260811 02:32:55.211836 31427 raft_consensus.cc:2454] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a013edd19de34e5eaaa65723b74424ed in term 1.
I20260811 02:32:55.211901 31560 leader_election.cc:302] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59332b5d9d0b41e1aad085ca6c24dd86, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:55.211993 31835 raft_consensus.cc:2781] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:55.212044 31835 raft_consensus.cc:686] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [term 1 LEADER]: Becoming Leader. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Running, Role: LEADER
I20260811 02:32:55.212265 31835 consensus_queue.cc:237] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.212767 31850 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: TxnStatusTablet state changed. Reason: New leader a013edd19de34e5eaaa65723b74424ed. Latest consensus state: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.212877 31850 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:55.213081 31887 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 02:32:55.213243 31887 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 02:32:55.213158 30930 catalog_manager.cc:5495] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed reported cstate change: term changed from 0 to 1, leader changed from <none> to a013edd19de34e5eaaa65723b74424ed (127.17.79.3). New cstate: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } health_report { overall_health: HEALTHY } } }
I20260811 02:32:55.225776 31821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.223105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35164 (local address 127.17.79.3:37553)
0811 02:32:55.223163 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.223166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.223180 (+ 14us) server_negotiation.cc:407] Connection header received
0811 02:32:55.223266 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.223267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.223275 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.223320 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:55.223501 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.223997 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.225088 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.225274 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.225337 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.225545 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.225571 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.225606 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.225698 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.225716 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:32:55.225831 31881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.223048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37553 (local address 127.0.0.1:35164)
0811 02:32:55.223132 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.223152 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.223195 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.223336 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.223337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.223338 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:55.223408 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.223410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.224082 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.224083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.225001 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.225004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.225357 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.225358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.225435 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.225454 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.225627 (+ 173us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.225640 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.225697 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.225748 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 02:32:55.226836 31193 raft_consensus.cc:1261] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Refusing update from remote peer a013edd19de34e5eaaa65723b74424ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.226878 31427 raft_consensus.cc:1261] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Refusing update from remote peer a013edd19de34e5eaaa65723b74424ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.227085 31835 consensus_queue.cc:1035] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.227185 31850 consensus_queue.cc:1035] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.227788 31833 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: TxnStatusTablet state changed. Reason: New leader a013edd19de34e5eaaa65723b74424ed. Latest consensus state: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.227905 31833 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:55.228051 31830 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: TxnStatusTablet state changed. Reason: New leader a013edd19de34e5eaaa65723b74424ed. Latest consensus state: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.228139 31830 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:55.228503 31835 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.228581 31835 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:55.229415 31833 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.229501 31833 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P 59332b5d9d0b41e1aad085ca6c24dd86: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:55.229912 31850 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.230021 31850 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P a013edd19de34e5eaaa65723b74424ed: This TxnStatusTablet replica's current role is: LEADER
I20260811 02:32:55.230355 31830 tablet_replica.cc:439] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a013edd19de34e5eaaa65723b74424ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } } }
I20260811 02:32:55.230463 31830 tablet_replica.cc:442] T 92f62e29755f40cc9e77a90652e55fac P 4ca18e7f671f4868b5ad22bb4e3f11d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 02:32:55.236272 31821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.233679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:36097 (local address 127.17.79.3:37553)
0811 02:32:55.233734 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.233736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.233742 (+ 6us) server_negotiation.cc:407] Connection header received
0811 02:32:55.233760 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.233760 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.233768 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.233816 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:55.233945 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.234485 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.235593 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.235775 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.235836 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.236048 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.236078 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.236121 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.236189 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.236204 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 02:32:55.236366 31784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.233487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37553 (local address 127.17.79.3:36097)
0811 02:32:55.233562 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.233574 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.233610 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.233840 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.233841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.233842 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:55.233889 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.233890 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.234559 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.234560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.235468 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.235470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.235873 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.235874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.235938 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.235958 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.236136 (+ 178us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.236137 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.236188 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.236235 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 02:32:55.238770 31193 raft_consensus.cc:1261] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Refusing update from remote peer a013edd19de34e5eaaa65723b74424ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.238998 31850 consensus_queue.cc:1035] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.238785 31427 raft_consensus.cc:1261] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Refusing update from remote peer a013edd19de34e5eaaa65723b74424ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.239400 31850 consensus_queue.cc:1035] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.241120 31846 mvcc.cc:205] Tried to move back new op lower bound from 7317158196176723968 to 7317158195268730880. Current Snapshot: MvccSnapshot[applied={T|T < 7317158196176723968}]
I20260811 02:32:55.250172 30930 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:55.250358 30930 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35216:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:55.251060 30930 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Sending DeleteTablet for 3 replicas of tablet 9c613da459d1442a8900300466275d4e
I20260811 02:32:55.251322 31401 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c613da459d1442a8900300466275d4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:43184
I20260811 02:32:55.251343 31164 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c613da459d1442a8900300466275d4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41018
I20260811 02:32:55.251437 31859 tablet_replica.cc:330] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: stopping tablet replica
I20260811 02:32:55.251441 31860 tablet_replica.cc:330] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: stopping tablet replica
I20260811 02:32:55.251427 31646 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c613da459d1442a8900300466275d4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:35144
I20260811 02:32:55.251498 31860 raft_consensus.cc:2229] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:55.251489 31859 raft_consensus.cc:2229] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:55.251535 31860 raft_consensus.cc:2258] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.251544 31859 raft_consensus.cc:2258] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.251552 31861 tablet_replica.cc:330] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: stopping tablet replica
I20260811 02:32:55.251612 31861 raft_consensus.cc:2229] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:55.251667 31861 raft_consensus.cc:2258] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.251884 31860 ts_tablet_manager.cc:1905] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.251943 31861 ts_tablet_manager.cc:1905] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.253232 31861 ts_tablet_manager.cc:1918] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:55.253315 31861 log.cc:1196] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/9c613da459d1442a8900300466275d4e
I20260811 02:32:55.253542 31861 ts_tablet_manager.cc:1939] T 9c613da459d1442a8900300466275d4e P a013edd19de34e5eaaa65723b74424ed: Deleting consensus metadata
I20260811 02:32:55.253899 31860 ts_tablet_manager.cc:1918] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:55.253971 31860 log.cc:1196] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/9c613da459d1442a8900300466275d4e
I20260811 02:32:55.254200 31860 ts_tablet_manager.cc:1939] T 9c613da459d1442a8900300466275d4e P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting consensus metadata
I20260811 02:32:55.254617 30902 catalog_manager.cc:4841] TS 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507): tablet 9c613da459d1442a8900300466275d4e (table test-table [id=a41c14c66833476aacab30b17bfb5c6a]) successfully deleted
I20260811 02:32:55.255199 30906 catalog_manager.cc:4841] TS a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553): tablet 9c613da459d1442a8900300466275d4e (table test-table [id=a41c14c66833476aacab30b17bfb5c6a]) successfully deleted
I20260811 02:32:55.255453 31859 ts_tablet_manager.cc:1905] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.256650 31859 ts_tablet_manager.cc:1918] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:55.256731 31859 log.cc:1196] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/9c613da459d1442a8900300466275d4e
I20260811 02:32:55.256932 31859 ts_tablet_manager.cc:1939] T 9c613da459d1442a8900300466275d4e P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting consensus metadata
I20260811 02:32:55.257366 30909 catalog_manager.cc:4841] TS 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227): tablet 9c613da459d1442a8900300466275d4e (table test-table [id=a41c14c66833476aacab30b17bfb5c6a]) successfully deleted
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[30855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 02:32:55.282892 31016 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:55.276595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35230 (local address 127.17.79.62:36631)
0811 02:32:55.276666 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.276669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.276769 (+ 100us) server_negotiation.cc:407] Connection header received
0811 02:32:55.276843 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.276844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.276853 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.276905 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:55.277611 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.278118 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.279242 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.279437 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.279496 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.282799 (+ 3303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35230: BlockingRecv error: recv got EOF from 127.0.0.1:35230 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[30855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM
I20260811 02:32:55.291713 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.283807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.17.79.62:36631)
0811 02:32:55.283844 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.283846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.283880 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:32:55.283956 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.283957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.283965 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.284009 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:55.284661 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.285305 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.286370 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.286544 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.286607 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.289052 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:55.289057 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:55.289057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:55.289064 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:55.290562 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:55.290918 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:55.290919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:55.290919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:55.290978 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:55.291189 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:55.291190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:55.291190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:55.291299 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:55.291400 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.291522 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.291601 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:32:55.293238 30930 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35232:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:55.293419 30930 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:55.294883 31164 tablet_service.cc:1467] Processing CreateTablet for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c (DEFAULT_TABLE table=test-table [id=32f9301f64a844cf9fc87816faaf559a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:55.294940 31401 tablet_service.cc:1467] Processing CreateTablet for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c (DEFAULT_TABLE table=test-table [id=32f9301f64a844cf9fc87816faaf559a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:55.294988 31646 tablet_service.cc:1467] Processing CreateTablet for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c (DEFAULT_TABLE table=test-table [id=32f9301f64a844cf9fc87816faaf559a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:55.295040 31164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.295079 31401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.295102 31646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.296468 31826 tablet_bootstrap.cc:492] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: Bootstrap starting.
I20260811 02:32:55.296680 31824 tablet_bootstrap.cc:492] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: Bootstrap starting.
I20260811 02:32:55.297134 31824 tablet_bootstrap.cc:654] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.297158 31826 tablet_bootstrap.cc:654] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.296514 31827 tablet_bootstrap.cc:492] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: Bootstrap starting.
I20260811 02:32:55.297814 31826 tablet_bootstrap.cc:492] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: No bootstrap required, opened a new log
I20260811 02:32:55.297863 31827 tablet_bootstrap.cc:654] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.297880 31826 ts_tablet_manager.cc:1397] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:55.297989 31826 raft_consensus.cc:348] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.298079 31826 raft_consensus.cc:374] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.298107 31826 raft_consensus.cc:729] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.298157 31826 consensus_queue.cc:260] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.298278 31826 ts_tablet_manager.cc:1428] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:55.298563 31824 tablet_bootstrap.cc:492] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: No bootstrap required, opened a new log
I20260811 02:32:55.298616 31824 ts_tablet_manager.cc:1397] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 02:32:55.298779 31824 raft_consensus.cc:348] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.298851 31824 raft_consensus.cc:374] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.298870 31824 raft_consensus.cc:729] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca18e7f671f4868b5ad22bb4e3f11d9, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.298938 31824 consensus_queue.cc:260] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.299013 31827 tablet_bootstrap.cc:492] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: No bootstrap required, opened a new log
I20260811 02:32:55.299026 31824 ts_tablet_manager.cc:1428] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:55.299057 31827 ts_tablet_manager.cc:1397] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:55.299223 31827 raft_consensus.cc:348] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.299306 31827 raft_consensus.cc:374] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.299331 31827 raft_consensus.cc:729] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59332b5d9d0b41e1aad085ca6c24dd86, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.299373 31827 consensus_queue.cc:260] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.299482 31827 ts_tablet_manager.cc:1428] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:55.532912 31830 raft_consensus.cc:482] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:55.533027 31830 raft_consensus.cc:504] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.533461 31830 leader_election.cc:288] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553)
I20260811 02:32:55.536581 31929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.533675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:36227 (local address 127.17.79.2:39775)
0811 02:32:55.533835 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.533848 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.533910 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.534101 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.534103 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.534105 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:55.534171 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.534174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.534872 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.534873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.535692 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.535695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.536326 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.536327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.536393 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.536398 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.536458 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.536489 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":69,"threads_started":1}
I20260811 02:32:55.536731 31821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.533772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:52981 (local address 127.17.79.3:37553)
0811 02:32:55.533841 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.533843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.533970 (+ 127us) server_negotiation.cc:407] Connection header received
0811 02:32:55.534033 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.534034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.534045 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.534118 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:55.534356 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.534801 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.535929 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.536311 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.536382 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.536394 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.536607 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.536648 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 02:32:55.536842 31932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.533771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:39775 (local address 127.17.79.1:36227)
0811 02:32:55.533898 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.533900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.533912 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:32:55.533996 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.533997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.534009 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.534083 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:55.534261 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.534779 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.535801 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.536234 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.536291 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.536302 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.536474 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.536520 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
I20260811 02:32:55.537098 31192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f193b3e65cb04ff8bb5536dbb9d9dc4c" candidate_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" is_pre_election: true
I20260811 02:32:55.537199 31192 raft_consensus.cc:2454] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ca18e7f671f4868b5ad22bb4e3f11d9 in term 0.
I20260811 02:32:55.537403 31313 leader_election.cc:302] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca18e7f671f4868b5ad22bb4e3f11d9, 59332b5d9d0b41e1aad085ca6c24dd86; no voters:
I20260811 02:32:55.537515 31930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.533675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37553 (local address 127.17.79.2:52981)
0811 02:32:55.533861 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.533875 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.533968 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.534146 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.534148 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.534150 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:55.534281 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.534283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.534919 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.534920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.535834 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.535837 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.536423 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.536424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.536513 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.536517 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.536578 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.536614 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":38,"thread_start_us":59,"threads_started":1}
I20260811 02:32:55.537598 31830 raft_consensus.cc:2781] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:55.537663 31830 raft_consensus.cc:482] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:55.537695 31830 raft_consensus.cc:3037] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.537823 31683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f193b3e65cb04ff8bb5536dbb9d9dc4c" candidate_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a013edd19de34e5eaaa65723b74424ed" is_pre_election: true
I20260811 02:32:55.537967 31683 raft_consensus.cc:2454] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ca18e7f671f4868b5ad22bb4e3f11d9 in term 0.
I20260811 02:32:55.538614 31830 raft_consensus.cc:504] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.538761 31830 leader_election.cc:288] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [CANDIDATE]: Term 1 election: Requested vote from peers 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227), a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553)
I20260811 02:32:55.538944 31683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f193b3e65cb04ff8bb5536dbb9d9dc4c" candidate_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a013edd19de34e5eaaa65723b74424ed"
I20260811 02:32:55.539014 31683 raft_consensus.cc:3037] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.538968 31192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f193b3e65cb04ff8bb5536dbb9d9dc4c" candidate_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59332b5d9d0b41e1aad085ca6c24dd86"
I20260811 02:32:55.539057 31192 raft_consensus.cc:3037] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.539664 31683 raft_consensus.cc:2454] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca18e7f671f4868b5ad22bb4e3f11d9 in term 1.
I20260811 02:32:55.539837 31192 raft_consensus.cc:2454] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca18e7f671f4868b5ad22bb4e3f11d9 in term 1.
I20260811 02:32:55.539835 31311 leader_election.cc:302] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca18e7f671f4868b5ad22bb4e3f11d9, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:55.540014 31830 raft_consensus.cc:2781] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:55.540128 31830 raft_consensus.cc:686] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 LEADER]: Becoming Leader. State: Replica: 4ca18e7f671f4868b5ad22bb4e3f11d9, State: Running, Role: LEADER
I20260811 02:32:55.540213 31830 consensus_queue.cc:237] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.540930 30930 catalog_manager.cc:5495] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } health_report { overall_health: UNKNOWN } } }
I20260811 02:32:55.585335 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.582455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43194 (local address 127.17.79.2:45507)
0811 02:32:55.582618 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.582620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.582626 (+ 6us) server_negotiation.cc:407] Connection header received
0811 02:32:55.582665 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.582666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.582682 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.582770 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:55.582923 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.583521 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.584289 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.584628 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.584712 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.584887 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.584978 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.585039 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.585169 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.585226 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":62,"threads_started":1}
I20260811 02:32:55.586365 31192 raft_consensus.cc:1261] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Refusing update from remote peer 4ca18e7f671f4868b5ad22bb4e3f11d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.586405 31683 raft_consensus.cc:1261] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Refusing update from remote peer 4ca18e7f671f4868b5ad22bb4e3f11d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.586669 31830 consensus_queue.cc:1035] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.586826 31933 consensus_queue.cc:1035] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.590258 30930 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:55.590368 30930 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:55.591017 30930 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Sending DeleteTablet for 3 replicas of tablet f193b3e65cb04ff8bb5536dbb9d9dc4c
I20260811 02:32:55.591270 31401 tablet_service.cc:1514] Processing DeleteTablet for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:43184
I20260811 02:32:55.591305 31164 tablet_service.cc:1514] Processing DeleteTablet for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41018
I20260811 02:32:55.591362 31860 tablet_replica.cc:330] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: stopping tablet replica
I20260811 02:32:55.591411 31860 raft_consensus.cc:2229] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:55.591408 31859 tablet_replica.cc:330] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: stopping tablet replica
I20260811 02:32:55.591461 31859 raft_consensus.cc:2229] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:55.591501 31859 raft_consensus.cc:2258] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.591495 31860 raft_consensus.cc:2258] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.591594 31646 tablet_service.cc:1514] Processing DeleteTablet for tablet f193b3e65cb04ff8bb5536dbb9d9dc4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:35144
I20260811 02:32:55.591640 30930 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35232:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:32:55.591789 30930 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:32:55.591801 31861 tablet_replica.cc:330] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: stopping tablet replica
I20260811 02:32:55.591861 31861 raft_consensus.cc:2229] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:55.591909 31861 raft_consensus.cc:2258] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.592423 31861 ts_tablet_manager.cc:1905] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.593181 31164 tablet_service.cc:1467] Processing CreateTablet for tablet 90ee3f9fdc0d4623ba91e460488d70da (DEFAULT_TABLE table=test-table [id=6a79b1fdc41943ef8054b3af7063711e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:55.593313 31164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90ee3f9fdc0d4623ba91e460488d70da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.593951 31861 ts_tablet_manager.cc:1918] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:55.594017 31861 log.cc:1196] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/f193b3e65cb04ff8bb5536dbb9d9dc4c
I20260811 02:32:55.594254 31861 ts_tablet_manager.cc:1939] T f193b3e65cb04ff8bb5536dbb9d9dc4c P a013edd19de34e5eaaa65723b74424ed: Deleting consensus metadata
I20260811 02:32:55.594369 31401 tablet_service.cc:1467] Processing CreateTablet for tablet 90ee3f9fdc0d4623ba91e460488d70da (DEFAULT_TABLE table=test-table [id=6a79b1fdc41943ef8054b3af7063711e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:55.594475 31401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90ee3f9fdc0d4623ba91e460488d70da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.594551 31827 tablet_bootstrap.cc:492] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: Bootstrap starting.
I20260811 02:32:55.594571 30906 catalog_manager.cc:4841] TS a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553): tablet f193b3e65cb04ff8bb5536dbb9d9dc4c (table test-table [id=32f9301f64a844cf9fc87816faaf559a]) successfully deleted
I20260811 02:32:55.594961 31827 tablet_bootstrap.cc:654] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.595592 31827 tablet_bootstrap.cc:492] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: No bootstrap required, opened a new log
I20260811 02:32:55.595631 31827 ts_tablet_manager.cc:1397] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:55.595786 31827 raft_consensus.cc:348] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.595854 31827 raft_consensus.cc:374] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.595875 31827 raft_consensus.cc:729] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59332b5d9d0b41e1aad085ca6c24dd86, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.595920 31824 tablet_bootstrap.cc:492] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: Bootstrap starting.
I20260811 02:32:55.595921 31827 consensus_queue.cc:260] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.595947 31646 tablet_service.cc:1467] Processing CreateTablet for tablet 90ee3f9fdc0d4623ba91e460488d70da (DEFAULT_TABLE table=test-table [id=6a79b1fdc41943ef8054b3af7063711e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:32:55.596014 31827 ts_tablet_manager.cc:1428] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:55.596040 31646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90ee3f9fdc0d4623ba91e460488d70da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:55.596310 31824 tablet_bootstrap.cc:654] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.597299 31824 tablet_bootstrap.cc:492] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: No bootstrap required, opened a new log
I20260811 02:32:55.597344 31824 ts_tablet_manager.cc:1397] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:55.597448 31860 ts_tablet_manager.cc:1905] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.597465 31824 raft_consensus.cc:348] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.597536 31824 raft_consensus.cc:374] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.597561 31824 raft_consensus.cc:729] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca18e7f671f4868b5ad22bb4e3f11d9, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.597604 31824 consensus_queue.cc:260] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.597687 31824 ts_tablet_manager.cc:1428] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:55.597776 31826 tablet_bootstrap.cc:492] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: Bootstrap starting.
I20260811 02:32:55.598081 31826 tablet_bootstrap.cc:654] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:55.598685 31860 ts_tablet_manager.cc:1918] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:55.598738 31860 log.cc:1196] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/f193b3e65cb04ff8bb5536dbb9d9dc4c
I20260811 02:32:55.598932 31860 ts_tablet_manager.cc:1939] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting consensus metadata
I20260811 02:32:55.599412 30902 catalog_manager.cc:4841] TS 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507): tablet f193b3e65cb04ff8bb5536dbb9d9dc4c (table test-table [id=32f9301f64a844cf9fc87816faaf559a]) successfully deleted
I20260811 02:32:55.599941 31859 ts_tablet_manager.cc:1905] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.601259 31859 ts_tablet_manager.cc:1918] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:32:55.601321 31859 log.cc:1196] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/f193b3e65cb04ff8bb5536dbb9d9dc4c
I20260811 02:32:55.601526 31859 ts_tablet_manager.cc:1939] T f193b3e65cb04ff8bb5536dbb9d9dc4c P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting consensus metadata
I20260811 02:32:55.601827 30909 catalog_manager.cc:4841] TS 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227): tablet f193b3e65cb04ff8bb5536dbb9d9dc4c (table test-table [id=32f9301f64a844cf9fc87816faaf559a]) successfully deleted
I20260811 02:32:55.602627 31826 tablet_bootstrap.cc:492] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: No bootstrap required, opened a new log
I20260811 02:32:55.602684 31826 ts_tablet_manager.cc:1397] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 02:32:55.602813 31826 raft_consensus.cc:348] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.602886 31826 raft_consensus.cc:374] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:55.602906 31826 raft_consensus.cc:729] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a013edd19de34e5eaaa65723b74424ed, State: Initialized, Role: FOLLOWER
I20260811 02:32:55.602952 31826 consensus_queue.cc:260] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.603036 31826 ts_tablet_manager.cc:1428] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:55.636786 31833 raft_consensus.cc:482] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:32:55.636885 31833 raft_consensus.cc:504] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.637254 31833 leader_election.cc:288] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507), a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553)
I20260811 02:32:55.640933 31950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.637437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:45507 (local address 127.17.79.1:35277)
0811 02:32:55.637579 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.637591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.637650 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.637888 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.637889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.637892 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:55.637979 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.637981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.638976 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.638977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.639923 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.639926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.640655 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.640657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.640730 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.640734 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.640795 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.640835 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260811 02:32:55.640934 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.637578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:35277 (local address 127.17.79.2:45507)
0811 02:32:55.637634 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.637636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.637645 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:55.637736 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.637737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.637755 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.637807 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:55.638061 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.638859 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.640052 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.640560 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.640636 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.640657 (+ 21us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.640811 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.640852 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:55.641280 31426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90ee3f9fdc0d4623ba91e460488d70da" candidate_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" is_pre_election: true
I20260811 02:32:55.641386 31426 raft_consensus.cc:2454] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59332b5d9d0b41e1aad085ca6c24dd86 in term 0.
I20260811 02:32:55.641474 31821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.637606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:42037 (local address 127.17.79.3:37553)
0811 02:32:55.637666 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.637668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.637795 (+ 127us) server_negotiation.cc:407] Connection header received
0811 02:32:55.637832 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.637833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.637843 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.637918 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:32:55.638138 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.638858 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.640350 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.640878 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.640953 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.640963 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.641360 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.641409 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 02:32:55.641520 31951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.637456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37553 (local address 127.17.79.1:42037)
0811 02:32:55.637710 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.637719 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.637782 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.637924 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.637925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.637927 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:32:55.638019 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.638021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.638966 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.638967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.640249 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.640251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.641162 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.641163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.641260 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.641263 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.641351 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.641438 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":22,"thread_start_us":88,"threads_started":1}
I20260811 02:32:55.641736 31086 leader_election.cc:302] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca18e7f671f4868b5ad22bb4e3f11d9, 59332b5d9d0b41e1aad085ca6c24dd86; no voters:
I20260811 02:32:55.641744 31683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90ee3f9fdc0d4623ba91e460488d70da" candidate_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a013edd19de34e5eaaa65723b74424ed" is_pre_election: true
I20260811 02:32:55.641822 31683 raft_consensus.cc:2454] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59332b5d9d0b41e1aad085ca6c24dd86 in term 0.
I20260811 02:32:55.641867 31833 raft_consensus.cc:2781] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:32:55.641912 31833 raft_consensus.cc:482] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:32:55.641947 31833 raft_consensus.cc:3037] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.642865 31833 raft_consensus.cc:504] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.643010 31833 leader_election.cc:288] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507), a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553)
I20260811 02:32:55.643157 31426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90ee3f9fdc0d4623ba91e460488d70da" candidate_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9"
I20260811 02:32:55.643236 31426 raft_consensus.cc:3037] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.643217 31683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90ee3f9fdc0d4623ba91e460488d70da" candidate_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a013edd19de34e5eaaa65723b74424ed"
I20260811 02:32:55.643323 31683 raft_consensus.cc:3037] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:55.643957 31683 raft_consensus.cc:2454] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59332b5d9d0b41e1aad085ca6c24dd86 in term 1.
I20260811 02:32:55.644091 31426 raft_consensus.cc:2454] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59332b5d9d0b41e1aad085ca6c24dd86 in term 1.
I20260811 02:32:55.644137 31089 leader_election.cc:302] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59332b5d9d0b41e1aad085ca6c24dd86, a013edd19de34e5eaaa65723b74424ed; no voters:
I20260811 02:32:55.644233 31833 raft_consensus.cc:2781] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:55.644409 31833 raft_consensus.cc:686] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 LEADER]: Becoming Leader. State: Replica: 59332b5d9d0b41e1aad085ca6c24dd86, State: Running, Role: LEADER
I20260811 02:32:55.644490 31833 consensus_queue.cc:237] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } }
I20260811 02:32:55.645203 30930 catalog_manager.cc:5495] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1). New cstate: current_term: 1 leader_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59332b5d9d0b41e1aad085ca6c24dd86" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 } health_report { overall_health: UNKNOWN } } }
I20260811 02:32:55.661180 31932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.658460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41034 (local address 127.17.79.1:36227)
0811 02:32:55.658517 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.658519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.658526 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:32:55.658555 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.658555 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.658572 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.658636 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:55.658781 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.659239 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.660373 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.660569 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.660631 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.660806 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.660906 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.660960 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.661040 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.661059 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 02:32:55.666451 31821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.663835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:58149 (local address 127.17.79.3:37553)
0811 02:32:55.663883 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.663885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.664023 (+ 138us) server_negotiation.cc:407] Connection header received
0811 02:32:55.664088 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.664089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.664101 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.664146 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:55.664414 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.664899 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.665701 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.665896 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.665969 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.666159 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.666198 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.666302 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.666361 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.666381 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:32:55.666935 31962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.663722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:37553 (local address 127.17.79.1:58149)
0811 02:32:55.663938 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.663950 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.664034 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.664159 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.664159 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.664162 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:55.664226 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.664227 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.664986 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.664988 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.665606 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.665608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.665982 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.665984 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.666047 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.666068 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.666306 (+ 238us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.666308 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.666358 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.666400 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260811 02:32:55.669064 31427 raft_consensus.cc:1261] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Refusing update from remote peer 59332b5d9d0b41e1aad085ca6c24dd86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.669072 31683 raft_consensus.cc:1261] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Refusing update from remote peer 59332b5d9d0b41e1aad085ca6c24dd86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:32:55.669396 31952 consensus_queue.cc:1035] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a013edd19de34e5eaaa65723b74424ed" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 37553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.669507 31833 consensus_queue.cc:1035] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca18e7f671f4868b5ad22bb4e3f11d9" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:32:55.677363 31784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.674740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:36227 (local address 127.17.79.3:50779)
0811 02:32:55.674791 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:55.674802 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:55.674851 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:55.674977 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:55.674978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:55.674979 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 02:32:55.675010 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.675011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.675661 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.675662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.676478 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:55.676481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.676990 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.676991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:55.677056 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.677061 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.677242 (+ 181us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.677244 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:32:55.677275 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 02:32:55.677313 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 02:32:55.677366 31932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:55.674766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:50779 (local address 127.17.79.1:36227)
0811 02:32:55.674803 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:55.674805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:55.674836 (+ 31us) server_negotiation.cc:407] Connection header received
0811 02:32:55.674907 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:55.674908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:55.674918 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:55.674974 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:32:55.675105 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.675565 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.676583 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:55.676892 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:55.676961 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:55.677148 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:32:55.677179 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:32:55.677242 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:55.677278 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 02:32:55.677298 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:32:55.687547 30927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:55.687678 30927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:32:55.688433 30927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dba008e4635449a8f6a575231313d6a: Sending DeleteTablet for 3 replicas of tablet 90ee3f9fdc0d4623ba91e460488d70da
I20260811 02:32:55.688830 31164 tablet_service.cc:1514] Processing DeleteTablet for tablet 90ee3f9fdc0d4623ba91e460488d70da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41018
I20260811 02:32:55.688870 31646 tablet_service.cc:1514] Processing DeleteTablet for tablet 90ee3f9fdc0d4623ba91e460488d70da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:35144
I20260811 02:32:55.688966 31859 tablet_replica.cc:330] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: stopping tablet replica
I20260811 02:32:55.689013 31859 raft_consensus.cc:2229] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:32:55.689038 31401 tablet_service.cc:1514] Processing DeleteTablet for tablet 90ee3f9fdc0d4623ba91e460488d70da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:32:55 UTC) from {username='oryx', principal='oryx/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:43184
I20260811 02:32:55.689096 31859 raft_consensus.cc:2258] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.689139 31860 tablet_replica.cc:330] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: stopping tablet replica
I20260811 02:32:55.689175 31861 tablet_replica.cc:330] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: stopping tablet replica
I20260811 02:32:55.689188 31860 raft_consensus.cc:2229] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:55.689237 31861 raft_consensus.cc:2229] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:32:55.689261 31860 raft_consensus.cc:2258] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.689272 31861 raft_consensus.cc:2258] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:32:55.690042 31861 ts_tablet_manager.cc:1905] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.691692 31861 ts_tablet_manager.cc:1918] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:55.691759 31861 log.cc:1196] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/90ee3f9fdc0d4623ba91e460488d70da
I20260811 02:32:55.691980 31861 ts_tablet_manager.cc:1939] T 90ee3f9fdc0d4623ba91e460488d70da P a013edd19de34e5eaaa65723b74424ed: Deleting consensus metadata
I20260811 02:32:55.692358 31859 ts_tablet_manager.cc:1905] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.692349 30906 catalog_manager.cc:4841] TS a013edd19de34e5eaaa65723b74424ed (127.17.79.3:37553): tablet 90ee3f9fdc0d4623ba91e460488d70da (table test-table [id=6a79b1fdc41943ef8054b3af7063711e]) successfully deleted
I20260811 02:32:55.693902 31859 ts_tablet_manager.cc:1918] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:55.693964 31859 log.cc:1196] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/90ee3f9fdc0d4623ba91e460488d70da
I20260811 02:32:55.694172 31859 ts_tablet_manager.cc:1939] T 90ee3f9fdc0d4623ba91e460488d70da P 59332b5d9d0b41e1aad085ca6c24dd86: Deleting consensus metadata
I20260811 02:32:55.694504 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 31062
I20260811 02:32:55.694546 30909 catalog_manager.cc:4841] TS 59332b5d9d0b41e1aad085ca6c24dd86 (127.17.79.1:36227): tablet 90ee3f9fdc0d4623ba91e460488d70da (table test-table [id=6a79b1fdc41943ef8054b3af7063711e]) successfully deleted
I20260811 02:32:55.695215 31860 ts_tablet_manager.cc:1905] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:32:55.696731 31860 ts_tablet_manager.cc:1918] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 02:32:55.696781 31860 log.cc:1196] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/90ee3f9fdc0d4623ba91e460488d70da
I20260811 02:32:55.696973 31860 ts_tablet_manager.cc:1939] T 90ee3f9fdc0d4623ba91e460488d70da P 4ca18e7f671f4868b5ad22bb4e3f11d9: Deleting consensus metadata
I20260811 02:32:55.697822 30902 catalog_manager.cc:4841] TS 4ca18e7f671f4868b5ad22bb4e3f11d9 (127.17.79.2:45507): tablet 90ee3f9fdc0d4623ba91e460488d70da (table test-table [id=6a79b1fdc41943ef8054b3af7063711e]) successfully deleted
I20260811 02:32:55.708808 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 31283
I20260811 02:32:55.725238 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 31520
I20260811 02:32:55.742471 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 30873
2026-08-11T02:32:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3121 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[31980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[31980](info): set up 2 sockets
Aug 11 02:32:55 dist-test-slave-7nm7 krb5kdc[31980](info): commencing operation
krb5kdc: starting...
W20260811 02:32:57.036234 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:57 dist-test-slave-7nm7 krb5kdc[31980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:57.158666 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:34399
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:39763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:34399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:57.239976 32004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:57.240204 32004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:57.240239 32004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:57.241336 32004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:57.241403 32004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:57.241428 32004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:57.241458 32004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:57.241487 32004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:57.242960 32004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:39763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:34399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:34399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:57.243233 32004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:57.243459 32004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:32:57.248449 32004 server_base.cc:1034] running on GCE node
W20260811 02:32:57.248530 32018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:57.248420 32012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:57.248435 32013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:57.248872 32004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:57.249143 32004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:57.250296 32004 hybrid_clock.cc:648] HybridClock initialized: now 1786415577250281 us; error 28 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T02:32:57Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1501 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:32:57 dist-test-slave-7nm7 krb5kdc[32027](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:32:57 dist-test-slave-7nm7 krb5kdc[32027](info): set up 2 sockets
Aug 11 02:32:57 dist-test-slave-7nm7 krb5kdc[32027](info): commencing operation
krb5kdc: starting...
W20260811 02:32:58.543435 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:32:58 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:32:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:32:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:32:58.674407 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46431
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:46431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:58.762092 32054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:58.762380 32054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:58.762421 32054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:58.763563 32054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:58.763638 32054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:58.763665 32054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:58.763695 32054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:58.763717 32054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:58.765241 32054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:46431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:58.765524 32054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:58.765760 32054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:58.770995 32063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:58.771080 32066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:58.771109 32054 server_base.cc:1034] running on GCE node
W20260811 02:32:58.770995 32062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:58.771498 32054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:58.771760 32054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:58.772910 32054 hybrid_clock.cc:648] HybridClock initialized: now 1786415578772899 us; error 32 us; skew 500 ppm
Aug 11 02:32:58 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415578, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:58.778792 32054 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:58.779256 32054 webserver.cc:460] Webserver started at http://127.17.79.62:37999/ using document root <none> and password file <none>
I20260811 02:32:58.779488 32054 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:58.779536 32054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:58.779711 32054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:58.780856 32054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "80e8f206f6e46c438bf3cf9c0c2f11c4"
server_key_iv: "f73420f7334b8cffe5ff4426b4388b45"
server_key_version: "encryptionkey@0"
I20260811 02:32:58.781242 32054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "80e8f206f6e46c438bf3cf9c0c2f11c4"
server_key_iv: "f73420f7334b8cffe5ff4426b4388b45"
server_key_version: "encryptionkey@0"
I20260811 02:32:58.782678 32054 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:32:58.783479 32075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:58.783677 32054 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:58.783790 32054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "80e8f206f6e46c438bf3cf9c0c2f11c4"
server_key_iv: "f73420f7334b8cffe5ff4426b4388b45"
server_key_version: "encryptionkey@0"
I20260811 02:32:58.783864 32054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:58.811801 32054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:58.813858 32054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:58.814028 32054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:58.817966 32054 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:46431
I20260811 02:32:58.818005 32163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:46431 every 8 connection(s)
I20260811 02:32:58.818389 32054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:58.819307 32164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:32:58.820789 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 32054
I20260811 02:32:58.820925 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:32:58.821125 17724 external_mini_cluster.cc:1428] Setting key aac2d82cdcce4669a1d9e5b626053bee
I20260811 02:32:58.822113 32164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Bootstrap starting.
I20260811 02:32:58.822890 32164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Neither blocks nor log segments found. Creating new log.
I20260811 02:32:58.823205 32164 log.cc:824] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:58.823992 32164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: No bootstrap required, opened a new log
I20260811 02:32:58.826299 32164 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:58.826473 32164 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:32:58.826515 32164 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfc09a7a56d74ec28f7eebcd5f9bfb66, State: Initialized, Role: FOLLOWER
I20260811 02:32:58.826671 32164 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:58.826766 32164 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:58.826812 32164 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:58.826864 32164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:32:58.827462 32164 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:58.827550 32164 leader_election.cc:302] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfc09a7a56d74ec28f7eebcd5f9bfb66; no voters:
I20260811 02:32:58.827746 32164 leader_election.cc:288] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:32:58.827785 32172 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:32:58.827895 32172 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 LEADER]: Becoming Leader. State: Replica: dfc09a7a56d74ec28f7eebcd5f9bfb66, State: Running, Role: LEADER
I20260811 02:32:58.827976 32172 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:58.828040 32164 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:58.828306 32172 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } } }
I20260811 02:32:58.828379 32172 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: This master's current role is: LEADER
Aug 11 02:32:58 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:58.828514 32172 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfc09a7a56d74ec28f7eebcd5f9bfb66. Latest consensus state: current_term: 1 leader_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } } }
I20260811 02:32:58.828583 32172 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:58.828719 32177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:58.829262 32177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:58.831238 32177 catalog_manager.cc:1347] Generated new cluster ID: 9de80e1ca6ef4a99b30b36f206e8e2d9
I20260811 02:32:58.831293 32177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:58.832753 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:58.821677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40484 (local address 127.17.79.62:46431)
0811 02:32:58.821888 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:58.821897 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:58.821930 (+ 33us) server_negotiation.cc:407] Connection header received
0811 02:32:58.822527 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:58.822539 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:58.822604 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:58.822757 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:58.823441 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:58.824800 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:58.825524 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:58.826224 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:58.826369 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:58.829193 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:58.829198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:58.829198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:58.829210 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:58.831187 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:58.831579 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:58.831582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:58.831583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:58.831681 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:58.831898 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:58.831899 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:58.831899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:58.832130 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:58.832284 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:58.832403 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 02:32:58.832540 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":97,"threads_started":1}
I20260811 02:32:58.840925 32177 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:32:58.841454 32177 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:58.847029 32177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Generated new TSK 0
I20260811 02:32:58.847215 32177 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:32:58.879303 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46431
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:58.961992 32218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:58.962193 32218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:58.962215 32218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:58.963363 32218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:58.963402 32218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:58.963428 32218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:58.964879 32218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:58.965060 32218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:58.965237 32218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:58.970008 32228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:58.970016 32224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:58.970117 32225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:58.970325 32218 server_base.cc:1034] running on GCE node
I20260811 02:32:58.970525 32218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:58.970717 32218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:58.971890 32218 hybrid_clock.cc:648] HybridClock initialized: now 1786415578971882 us; error 41 us; skew 500 ppm
Aug 11 02:32:58 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415578, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:58.974397 32218 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:32:58.974835 32218 webserver.cc:460] Webserver started at http://127.17.79.1:38625/ using document root <none> and password file <none>
I20260811 02:32:58.975087 32218 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:58.975157 32218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:58.975307 32218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:58.976295 32218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "1421becc29db476cbd4ae9cf21ebdfd3"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "b6eb92c9de49fe0fa0f90d2bd7e6a996"
server_key_iv: "ad857dee320a4efd6ea5253d80d6637d"
server_key_version: "encryptionkey@0"
I20260811 02:32:58.976645 32218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "1421becc29db476cbd4ae9cf21ebdfd3"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "b6eb92c9de49fe0fa0f90d2bd7e6a996"
server_key_iv: "ad857dee320a4efd6ea5253d80d6637d"
server_key_version: "encryptionkey@0"
I20260811 02:32:58.977943 32218 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 02:32:58.978719 32240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:58.978884 32218 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:58.978986 32218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "1421becc29db476cbd4ae9cf21ebdfd3"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "b6eb92c9de49fe0fa0f90d2bd7e6a996"
server_key_iv: "ad857dee320a4efd6ea5253d80d6637d"
server_key_version: "encryptionkey@0"
I20260811 02:32:58.979077 32218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:58.987239 32218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:58.989156 32218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:58.989317 32218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:58.989533 32218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:58.989845 32218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:58.989902 32218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:58.989943 32218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:58.989970 32218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:58.995973 32218 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:46843
I20260811 02:32:58.996028 32443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:46843 every 8 connection(s)
I20260811 02:32:58.996373 32218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415578, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:59.004838 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 32218
I20260811 02:32:59.004944 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:32:59.005180 17724 external_mini_cluster.cc:1428] Setting key 9cc1b8e3f463d4258ad32701fdcc83bc
I20260811 02:32:59.006120 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:58.997150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:56345 (local address 127.17.79.62:46431)
0811 02:32:58.997215 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:58.997233 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:58.997421 (+ 188us) server_negotiation.cc:407] Connection header received
0811 02:32:58.997948 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:58.997949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:58.997962 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:58.998018 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:58.999011 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:58.999538 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.000530 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.000750 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.000823 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.003063 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:59.003064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:59.003065 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:59.003072 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:59.004376 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:59.004882 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:59.004883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:59.004884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:59.004988 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:59.005306 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:59.005308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:59.005308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:59.005456 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:59.005501 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:59.005881 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 02:32:59.006008 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 02:32:59.006283 32448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:58.997119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:56345)
0811 02:32:58.997305 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:58.997340 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:58.997843 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:58.998093 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:58.998097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:58.998721 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:58.998910 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:58.998915 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:58.999641 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:58.999642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.000422 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.000424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.000844 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.000845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.000968 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.001499 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.001508 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.002958 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:59.004464 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:59.004471 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:59.004474 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:59.004791 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:59.005057 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:59.005057 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:59.005058 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:59.005204 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:59.005555 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:59.005562 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:59.005748 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 02:32:59.005833 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 02:32:59.006009 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260811 02:32:59.006930 32444 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46431
I20260811 02:32:59.007027 32444 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:59.007225 32444 heartbeater.cc:511] Master 127.17.79.62:46431 requested a full tablet report, sending...
I20260811 02:32:59.007776 32100 ts_manager.cc:194] Registered new tserver with Master: 1421becc29db476cbd4ae9cf21ebdfd3 (127.17.79.1:46843)
I20260811 02:32:59.008431 32100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:56345
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:32:59.032841 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46431
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:59.114842 32452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:59.115048 32452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:59.115070 32452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:59.116127 32452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:59.116168 32452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:59.116194 32452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:59.117558 32452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:59.117760 32452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:59.118032 32452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:59.123318 32468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.123310 32462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.123308 32461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.123502 32452 server_base.cc:1034] running on GCE node
I20260811 02:32:59.123718 32452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:59.123970 32452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:59.125151 32452 hybrid_clock.cc:648] HybridClock initialized: now 1786415579125129 us; error 35 us; skew 500 ppm
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:59.127794 32452 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:32:59.128348 32452 webserver.cc:460] Webserver started at http://127.17.79.2:37901/ using document root <none> and password file <none>
I20260811 02:32:59.128600 32452 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:59.128671 32452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:59.128819 32452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:59.129951 32452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "68ce8c9cb22e41449d05b7e83097387e"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "ce8ac136cf4b96097cc6d32dc9935b53"
server_key_iv: "e75801996986ceb91bbfbd9e8d6acb89"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.130396 32452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "68ce8c9cb22e41449d05b7e83097387e"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "ce8ac136cf4b96097cc6d32dc9935b53"
server_key_iv: "e75801996986ceb91bbfbd9e8d6acb89"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.131778 32452 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:59.132640 32482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.132844 32452 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:59.132956 32452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "68ce8c9cb22e41449d05b7e83097387e"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "ce8ac136cf4b96097cc6d32dc9935b53"
server_key_iv: "e75801996986ceb91bbfbd9e8d6acb89"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.133031 32452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:59.148010 32452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:59.150213 32452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:59.150442 32452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:59.150696 32452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:59.151026 32452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:59.151082 32452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.151149 32452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:59.151244 32452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.157361 32452 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46545
I20260811 02:32:59.157414 32668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46545 every 8 connection(s)
I20260811 02:32:59.157752 32452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:32:59.158703 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 32452
I20260811 02:32:59.158824 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:32:59.159060 17724 external_mini_cluster.cc:1428] Setting key e4a0eb1ce561bc2356ecf907e3b97179
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:59.167552 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.158527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:44791 (local address 127.17.79.62:46431)
0811 02:32:59.158574 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.158576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.158841 (+ 265us) server_negotiation.cc:407] Connection header received
0811 02:32:59.159500 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.159502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.159516 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.159596 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.160602 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.161100 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.162107 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.162396 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.162483 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.164644 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:59.164645 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:59.164646 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:59.164653 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:59.166097 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:59.166568 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:59.166569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:59.166569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:59.166633 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:59.166890 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:59.166891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:59.166891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:59.167013 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:59.167094 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:59.167374 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 02:32:59.167461 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:32:59.167755 32673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.158527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:44791)
0811 02:32:59.158701 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.158738 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.159353 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.159654 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.159657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.160303 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.160500 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.160505 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.161224 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.161229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.162011 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.162013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.162494 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.162495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.162618 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.163194 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.163202 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.164535 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:59.166209 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:59.166217 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:59.166219 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:59.166476 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:59.166707 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:59.166707 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:59.166708 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:59.166819 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:59.167082 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:59.167090 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:59.167234 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 02:32:59.167340 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 02:32:59.167496 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":110,"threads_started":1}
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
I20260811 02:32:59.168614 32670 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46431
I20260811 02:32:59.168713 32670 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:59.168918 32670 heartbeater.cc:511] Master 127.17.79.62:46431 requested a full tablet report, sending...
I20260811 02:32:59.169508 32100 ts_manager.cc:194] Registered new tserver with Master: 68ce8c9cb22e41449d05b7e83097387e (127.17.79.2:46545)
I20260811 02:32:59.170022 32100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:44791
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:32:59.187443 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46431
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:59.272617 32680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:59.272800 32680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:59.272823 32680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:59.273896 32680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:59.273929 32680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:59.273955 32680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:59.275398 32680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:59.275593 32680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:59.275763 32680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:59.280831 32691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.280864 32680 server_base.cc:1034] running on GCE node
W20260811 02:32:59.280778 32690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.280779 32698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.281239 32680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:59.281533 32680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:59.282701 32680 hybrid_clock.cc:648] HybridClock initialized: now 1786415579282698 us; error 34 us; skew 500 ppm
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:59.285181 32680 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:32:59.285631 32680 webserver.cc:460] Webserver started at http://127.17.79.3:38761/ using document root <none> and password file <none>
I20260811 02:32:59.285876 32680 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:59.285944 32680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:59.286100 32680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:32:59.287269 32680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "97505777e58b46bdb9da623b5f5e3b88"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "b95a53a438dbeeecfd221799f8a83b65"
server_key_iv: "2ddbfa74c7bc93157b940c988c90d83e"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.287662 32680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "97505777e58b46bdb9da623b5f5e3b88"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "b95a53a438dbeeecfd221799f8a83b65"
server_key_iv: "2ddbfa74c7bc93157b940c988c90d83e"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.289036 32680 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:32:59.289880 32712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.290099 32680 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:59.290205 32680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "97505777e58b46bdb9da623b5f5e3b88"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "b95a53a438dbeeecfd221799f8a83b65"
server_key_iv: "2ddbfa74c7bc93157b940c988c90d83e"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.290307 32680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:59.302282 32680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:59.304010 32680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:59.304119 32680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:59.304288 32680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:59.304525 32680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:59.304555 32680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.304575 32680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:59.304595 32680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.310642 32680 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:46657
I20260811 02:32:59.310705 458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:46657 every 8 connection(s)
I20260811 02:32:59.311004 32680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:59.313102 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 32680
I20260811 02:32:59.313251 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:32:59.313441 17724 external_mini_cluster.cc:1428] Setting key 9370798e12f1c4c6d7083db3d282114f
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:32:59.320361 32169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.311764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:57521 (local address 127.17.79.62:46431)
0811 02:32:59.311811 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.311813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.312023 (+ 210us) server_negotiation.cc:407] Connection header received
0811 02:32:59.312496 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.312498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.312509 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.312583 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.313591 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.314441 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.315435 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.315626 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.315696 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.317819 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:59.317821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:59.317821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:59.317827 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:32:59.319120 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:59.319501 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:59.319501 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:59.319502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:59.319554 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:32:59.319808 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:32:59.319809 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:32:59.319809 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:32:59.319909 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:32:59.319960 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:32:59.320219 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 02:32:59.320293 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:32:59.320472 462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.311713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:57521)
0811 02:32:59.311886 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.311928 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.312390 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.312660 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.312664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.313209 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.313464 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.313468 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.314545 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.314546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.315345 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.315347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.315715 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.315716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.315827 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.316379 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.316395 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.317731 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:32:59.319195 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:59.319201 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:59.319203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:59.319407 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:59.319623 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:32:59.319624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:32:59.319624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:32:59.319747 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:32:59.319965 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:32:59.319971 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:32:59.320086 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 02:32:59.320182 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 02:32:59.320297 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260811 02:32:59.320974 459 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46431
I20260811 02:32:59.321056 459 heartbeater.cc:464] Registering TS with master...
I20260811 02:32:59.321250 459 heartbeater.cc:511] Master 127.17.79.62:46431 requested a full tablet report, sending...
I20260811 02:32:59.321648 32100 ts_manager.cc:194] Registered new tserver with Master: 97505777e58b46bdb9da623b5f5e3b88 (127.17.79.3:46657)
I20260811 02:32:59.322033 32100 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:57521
I20260811 02:32:59.325371 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab.
Entry for principal oryx/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab.
WARNING: no policy specified for oryx/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab.
Entry for principal oryx/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab.
WARNING: no policy specified for oryx/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab.
Entry for principal oryx/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab.
I20260811 02:32:59.401105 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 32218
I20260811 02:32:59.416163 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 32452
I20260811 02:32:59.436805 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 32680
I20260811 02:32:59.441448 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 32054
I20260811 02:32:59.456549 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46431
--webserver_interface=127.17.79.62
--webserver_port=37999
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:46431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:32:59.541169 477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:59.541374 477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:59.541396 477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:59.542537 477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:32:59.542580 477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:59.542595 477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:59.542614 477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:32:59.542626 477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:32:59.544370 477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:46431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=37999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:59.544576 477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:59.544777 477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:59.549652 491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.549662 489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.549823 477 server_base.cc:1034] running on GCE node
W20260811 02:32:59.549661 487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.550199 477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:59.550752 477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:59.551959 477 hybrid_clock.cc:648] HybridClock initialized: now 1786415579551944 us; error 26 us; skew 500 ppm
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:59.554692 477 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:32:59.555431 477 webserver.cc:460] Webserver started at http://127.17.79.62:37999/ using document root <none> and password file <none>
I20260811 02:32:59.555711 477 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:59.555800 477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:59.557286 477 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:59.558009 505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.558192 477 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:59.558326 477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "80e8f206f6e46c438bf3cf9c0c2f11c4"
server_key_iv: "f73420f7334b8cffe5ff4426b4388b45"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.558672 477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:59.570120 477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:59.572105 477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:59.572293 477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:59.576701 477 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:46431
I20260811 02:32:59.576731 589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:46431 every 8 connection(s)
I20260811 02:32:59.577117 477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:32:59.578724 595 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:32:59.579397 595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Bootstrap starting.
I20260811 02:32:59.582108 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 477
I20260811 02:32:59.582497 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:46843
--local_ip_for_outbound_sockets=127.17.79.1
--tserver_master_addrs=127.17.79.62:46431
--webserver_port=38625
--webserver_interface=127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:32:59.588713 595 log.cc:824] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Log is configured to *not* fsync() on all Append() calls
I20260811 02:32:59.590512 595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:32:59.590826 595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Bootstrap complete.
I20260811 02:32:59.593164 595 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:59.593384 595 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfc09a7a56d74ec28f7eebcd5f9bfb66, State: Initialized, Role: FOLLOWER
I20260811 02:32:59.593544 595 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:59.593619 595 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:32:59.593683 595 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:32:59.593730 595 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 1 FOLLOWER]: Advancing to term 2
I20260811 02:32:59.594790 595 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:59.594878 595 leader_election.cc:302] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfc09a7a56d74ec28f7eebcd5f9bfb66; no voters:
I20260811 02:32:59.595098 595 leader_election.cc:288] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 02:32:59.595134 599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 02:32:59.595255 599 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [term 2 LEADER]: Becoming Leader. State: Replica: dfc09a7a56d74ec28f7eebcd5f9bfb66, State: Running, Role: LEADER
I20260811 02:32:59.595392 595 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:32:59.595410 599 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } }
I20260811 02:32:59.595818 600 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfc09a7a56d74ec28f7eebcd5f9bfb66. Latest consensus state: current_term: 2 leader_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } } }
I20260811 02:32:59.595913 600 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:59.596138 603 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfc09a7a56d74ec28f7eebcd5f9bfb66" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46431 } } }
I20260811 02:32:59.596220 603 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66 [sys.catalog]: This master's current role is: LEADER
I20260811 02:32:59.596421 612 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:32:59.597004 612 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:32:59.597133 612 catalog_manager.cc:1259] Loaded cluster ID: 9de80e1ca6ef4a99b30b36f206e8e2d9
I20260811 02:32:59.597234 612 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:32:59.598575 612 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:32:59.598750 612 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dfc09a7a56d74ec28f7eebcd5f9bfb66: Loaded TSK: 0
I20260811 02:32:59.598955 612 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 02:32:59.667026 597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:59.667243 597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:59.667268 597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:59.668428 597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:59.668469 597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:59.668496 597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:32:59.670001 597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.1.keytab
--principal=oryx/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:46843
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=38625
--tserver_master_addrs=127.17.79.62:46431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:59.670269 597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:59.670521 597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:59.676682 648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.676668 644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.676673 642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.676999 597 server_base.cc:1034] running on GCE node
I20260811 02:32:59.677203 597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:59.677450 597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:59.678634 597 hybrid_clock.cc:648] HybridClock initialized: now 1786415579678620 us; error 31 us; skew 500 ppm
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:59.681372 597 init.cc:377] Logged in from keytab as oryx/127.17.79.1@KRBTEST.COM (short username oryx)
I20260811 02:32:59.681900 597 webserver.cc:460] Webserver started at http://127.17.79.1:38625/ using document root <none> and password file <none>
I20260811 02:32:59.682158 597 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:59.682282 597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:59.683670 597 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:32:59.684305 658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.684458 597 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:32:59.684535 597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "1421becc29db476cbd4ae9cf21ebdfd3"
format_stamp: "Formatted at 2026-08-11 02:32:58 on dist-test-slave-7nm7"
server_key: "b6eb92c9de49fe0fa0f90d2bd7e6a996"
server_key_iv: "ad857dee320a4efd6ea5253d80d6637d"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.684916 597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:59.695056 597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:59.697425 597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:59.697570 597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:59.697860 597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:59.698297 597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:59.698347 597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.698372 597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:59.698385 597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.705971 597 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:46843
I20260811 02:32:59.705999 861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:46843 every 8 connection(s)
I20260811 02:32:59.706434 597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:32:59.708477 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 597
I20260811 02:32:59.708801 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:46545
--local_ip_for_outbound_sockets=127.17.79.2
--tserver_master_addrs=127.17.79.62:46431
--webserver_port=37901
--webserver_interface=127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:32:59.716389 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.707199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:33259)
0811 02:32:59.707651 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.707687 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.708200 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.708696 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.708700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.709396 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.709582 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.709587 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.711086 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.711087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.712320 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.712324 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.712976 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.712977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.713217 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.713828 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.713836 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.716177 (+ 2341us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":365,"threads_started":1}
W20260811 02:32:59.716713 862 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:46431 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.79.62:46431: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
W20260811 02:32:59.716734 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:59.707267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:33259 (local address 127.17.79.62:46431)
0811 02:32:59.707451 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.707461 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.707800 (+ 339us) server_negotiation.cc:407] Connection header received
0811 02:32:59.708426 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.708430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.708472 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.708609 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.709713 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.710964 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.712417 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.712865 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.713000 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.716292 (+ 3292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:33259: BlockingRecv error: recv got EOF from 127.17.79.1:33259 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:32:59.726702 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.716954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:37537)
0811 02:32:59.722358 (+ 5404us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.722369 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.722439 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.722593 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.722594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.722730 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.722780 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.722782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.723433 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.723434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.723939 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.723940 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.724336 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.724337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.724397 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.724872 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.724876 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.726607 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":5385}
W20260811 02:32:59.726751 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:59.716999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:37537 (local address 127.17.79.62:46431)
0811 02:32:59.717070 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.717072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.722425 (+ 5353us) server_negotiation.cc:407] Connection header received
0811 02:32:59.722505 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.722506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.722525 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.722590 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.722859 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.723349 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.724026 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.724212 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.724291 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.726686 (+ 2395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:37537: BlockingRecv error: recv got EOF from 127.17.79.1:37537 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:32:59.731947 865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.727249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:45727)
0811 02:32:59.727386 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.727398 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.727449 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.727575 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.727575 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.727704 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.727732 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.727733 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.728336 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.728337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.728829 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.728830 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.729572 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.729574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.729635 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.730106 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.730111 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.731861 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116}
W20260811 02:32:59.732005 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:59.727373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:45727 (local address 127.17.79.62:46431)
0811 02:32:59.727420 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.727422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.727433 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:59.727501 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.727502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.727513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.727568 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.727817 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.728257 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.728927 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.729274 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.729575 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.731941 (+ 2366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:45727: BlockingRecv error: recv got EOF from 127.17.79.1:45727 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 02:32:59.732331 862 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 02:32:59.800015 867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:59.800217 867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:59.800240 867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:59.801298 867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:59.801333 867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:59.801358 867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:32:59.802711 867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.2.keytab
--principal=oryx/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:46545
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=37901
--tserver_master_addrs=127.17.79.62:46431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:59.802881 867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:59.803046 867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:59.808059 875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.808320 880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.808033 878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.808487 867 server_base.cc:1034] running on GCE node
I20260811 02:32:59.808712 867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:59.808984 867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:59.810125 867 hybrid_clock.cc:648] HybridClock initialized: now 1786415579810103 us; error 40 us; skew 500 ppm
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:59.813130 867 init.cc:377] Logged in from keytab as oryx/127.17.79.2@KRBTEST.COM (short username oryx)
I20260811 02:32:59.813621 867 webserver.cc:460] Webserver started at http://127.17.79.2:37901/ using document root <none> and password file <none>
I20260811 02:32:59.813871 867 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:59.813953 867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:59.817659 867 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260811 02:32:59.818367 894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.818569 867 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:32:59.818648 867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "68ce8c9cb22e41449d05b7e83097387e"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "ce8ac136cf4b96097cc6d32dc9935b53"
server_key_iv: "e75801996986ceb91bbfbd9e8d6acb89"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.819096 867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:59.842350 867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:59.844146 867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:59.844256 867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:59.844437 867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:59.844754 867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:59.844789 867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.844811 867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:59.844859 867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.850796 867 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46545
I20260811 02:32:59.850843 1066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46545 every 8 connection(s)
I20260811 02:32:59.851167 867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:32:59.858011 1072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.851801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:56329)
0811 02:32:59.851956 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.851997 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.852453 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.852656 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.852659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.853197 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.853379 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.853383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.854017 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.854018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.854864 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.854866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.855196 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.855197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.855295 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.855719 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.855727 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.857858 (+ 2131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
W20260811 02:32:59.858026 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:59.851842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:56329 (local address 127.17.79.62:46431)
0811 02:32:59.851892 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.851894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.852083 (+ 189us) server_negotiation.cc:407] Connection header received
0811 02:32:59.852531 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.852532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.852543 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.852602 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.853457 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.853936 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.854937 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.855111 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.855166 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.857941 (+ 2775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:56329: BlockingRecv error: recv got EOF from 127.17.79.2:56329 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 02:32:59.858218 1069 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:46431 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.79.62:46431: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
I20260811 02:32:59.858258 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 867
I20260811 02:32:59.858567 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:46657
--local_ip_for_outbound_sockets=127.17.79.3
--tserver_master_addrs=127.17.79.62:46431
--webserver_port=38761
--webserver_interface=127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:32:59.862934 1072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.858465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:55765)
0811 02:32:59.858518 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.858529 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.858571 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.858736 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.858736 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.858880 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.858921 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.858922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.859763 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.859764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.860222 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.860223 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.860588 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.860589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.860662 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.861052 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.861055 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.862855 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 02:32:59.863018 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:59.858527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:55765 (local address 127.17.79.62:46431)
0811 02:32:59.858596 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.858598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.858608 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:32:59.858629 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.858630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.858646 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.858696 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.858995 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.859669 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.860307 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.860486 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.860575 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.862952 (+ 2377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:55765: BlockingRecv error: recv got EOF from 127.17.79.2:55765 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:32:59.867875 1072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.863320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:33939)
0811 02:32:59.863397 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.863409 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.863456 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.863569 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.863570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.863736 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.863773 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.863774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.864347 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.864348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.865245 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.865248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.865566 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.865567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.865632 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.865980 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.865986 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.867783 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 02:32:59.867885 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:59.863416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:33939 (local address 127.17.79.62:46431)
0811 02:32:59.863467 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.863468 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.863479 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:32:59.863501 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.863501 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.863509 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.863561 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.863847 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.864270 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.865332 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.865494 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.865543 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.867849 (+ 2306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:33939: BlockingRecv error: recv got EOF from 127.17.79.2:33939 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 02:32:59.868165 1069 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 02:32:59.942512 1073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:32:59.942719 1073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:32:59.942756 1073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:32:59.943862 1073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:32:59.943928 1073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:32:59.943974 1073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:32:59.945446 1073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/krb5kdc/oryx_127.17.79.3.keytab
--principal=oryx/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:46657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=38761
--tserver_master_addrs=127.17.79.62:46431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:32:59.945703 1073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:32:59.945930 1073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:32:59.950914 1085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.950906 1082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:32:59.950906 1080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:32:59.951133 1073 server_base.cc:1034] running on GCE node
I20260811 02:32:59.951357 1073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:32:59.951591 1073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:32:59.952767 1073 hybrid_clock.cc:648] HybridClock initialized: now 1786415579952758 us; error 27 us; skew 500 ppm
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415579, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:32:59.955319 1073 init.cc:377] Logged in from keytab as oryx/127.17.79.3@KRBTEST.COM (short username oryx)
I20260811 02:32:59.955695 1073 webserver.cc:460] Webserver started at http://127.17.79.3:38761/ using document root <none> and password file <none>
I20260811 02:32:59.955893 1073 fs_manager.cc:359] Metadata directory not provided
I20260811 02:32:59.955942 1073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:32:59.957197 1073 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:32:59.957747 1098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.957927 1073 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:32:59.958006 1073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "97505777e58b46bdb9da623b5f5e3b88"
format_stamp: "Formatted at 2026-08-11 02:32:59 on dist-test-slave-7nm7"
server_key: "b95a53a438dbeeecfd221799f8a83b65"
server_key_iv: "2ddbfa74c7bc93157b940c988c90d83e"
server_key_version: "encryptionkey@0"
I20260811 02:32:59.958359 1073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:32:59.981890 1073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:32:59.984225 1073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:32:59.984339 1073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:32:59.984536 1073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:32:59.984885 1073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:32:59.984921 1073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.984944 1073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:32:59.984994 1073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:32:59.990933 1073 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:46657
I20260811 02:32:59.991043 1297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:46657 every 8 connection(s)
I20260811 02:32:59.991369 1073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:32:59.995042 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 1073
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:32:59 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 02:33:00.000006 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:32:59.992214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:60035 (local address 127.17.79.62:46431)
0811 02:32:59.992326 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.992328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.992622 (+ 294us) server_negotiation.cc:407] Connection header received
0811 02:32:59.993168 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.993169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.993179 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.993236 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.994219 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.994761 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.996221 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.996542 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.996623 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.999952 (+ 3329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:60035: BlockingRecv error: recv got EOF from 127.17.79.3:60035 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 02:33:00.000090 1307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.992263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:60035)
0811 02:32:59.992442 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 02:32:59.992483 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 02:32:59.993054 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:32:59.993330 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:32:59.993333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:32:59.993924 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:32:59.994127 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.994131 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.994871 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.994873 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.996138 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:32:59.996141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.996647 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.996648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:32:59.996824 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.997350 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:32:59.997360 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:32:59.999886 (+ 2526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
W20260811 02:33:00.000507 1298 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:46431 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.79.62:46431: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
I20260811 02:33:00.003299 1310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:32:59.995683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40494 (local address 127.17.79.62:46431)
0811 02:32:59.995816 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 02:32:59.995818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:32:59.995827 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:32:59.995849 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:32:59.995850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:32:59.995862 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:32:59.995942 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:32:59.996716 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.997428 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.998330 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:32:59.998622 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:32:59.998694 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:32:59.999913 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:32:59.999918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:32:59.999918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:32:59.999930 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:00.001859 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:00.002216 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:00.002219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:00.002220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:00.002368 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:00.002562 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:00.002562 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:00.002563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:00.002837 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:00.002954 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:00.003103 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 02:33:00.003227 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":87,"threads_started":1}
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:00.005329 1307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:00.000888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:35797)
0811 02:33:00.000932 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:00.000941 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:00.000980 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:00.001143 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:00.001144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:00.001290 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:00.001340 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.001342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.001928 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.001929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.002640 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.002643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.003005 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.003006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.003076 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.003498 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:00.003501 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:00.005237 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 02:33:00.005383 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:00.000936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:35797 (local address 127.17.79.62:46431)
0811 02:33:00.001041 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:00.001043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:00.001050 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:33:00.001065 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:00.001066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:00.001073 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:00.001119 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:00.001425 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.001848 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.002716 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.002924 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.002993 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.005322 (+ 2329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:35797: BlockingRecv error: recv got EOF from 127.17.79.3:35797 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:00.009712 1307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:00.005630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:49941)
0811 02:33:00.005721 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:00.005732 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:00.005803 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:00.005931 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:00.005931 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:00.006052 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:00.006076 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.006077 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.006744 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.006745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.007292 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.007294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.007682 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.007683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.007739 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.008187 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:00.008191 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:00.009635 (+ 1444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
W20260811 02:33:00.009757 864 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:00.005662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:49941 (local address 127.17.79.62:46431)
0811 02:33:00.005718 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:00.005720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:00.005789 (+ 69us) server_negotiation.cc:407] Connection header received
0811 02:33:00.005871 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:00.005872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:00.005881 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:00.005929 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:00.006154 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.006653 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.007385 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.007581 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.007650 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.009700 (+ 2050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:49941: BlockingRecv error: recv got EOF from 127.17.79.3:49941 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 02:33:00.009862 1298 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:00.737192 1312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:00.732759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:44013)
0811 02:33:00.732901 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:00.732912 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:00.732960 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:00.733111 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:00.733112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:00.733294 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:00.733343 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.733345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.733987 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.733988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.734605 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.734608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.734936 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.734937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.734977 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.735423 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:00.735429 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:00.737124 (+ 1695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
W20260811 02:33:00.737298 1316 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:00.732852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:44013 (local address 127.17.79.62:46431)
0811 02:33:00.732990 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:00.732992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:00.732999 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:33:00.733019 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:00.733020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:00.733029 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:00.733097 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:00.733415 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.733911 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.734676 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.734872 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.734923 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.737219 (+ 2296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:44013: BlockingRecv error: recv got EOF from 127.17.79.1:44013 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:00 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:00.875298 1317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:00.868921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:58409)
0811 02:33:00.869099 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:00.869113 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:00.869198 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:00.869447 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:00.869448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:00.869627 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:00.869695 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.869696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.870947 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.870949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.871658 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:00.871661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.872159 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.872160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:00.872212 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.873270 (+ 1058us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:00.873276 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:00.875218 (+ 1942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
W20260811 02:33:00.875412 1316 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:00.868960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:58409 (local address 127.17.79.62:46431)
0811 02:33:00.869069 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:00.869072 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:00.869207 (+ 135us) server_negotiation.cc:407] Connection header received
0811 02:33:00.869241 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:00.869242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:00.869256 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:00.869449 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:00.869823 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.870789 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.871766 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:00.872046 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:00.872127 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:00.875338 (+ 3211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:58409: BlockingRecv error: recv got EOF from 127.17.79.2:58409 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 02:33:01 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:01 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:01.014909 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:01.010285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:54133)
0811 02:33:01.010404 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:01.010415 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:01.010476 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:01.010601 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:01.010602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:01.010761 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:01.010811 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:01.010812 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.011487 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.011488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:01.012026 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:01.012028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.012421 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.012422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:01.012483 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:01.012910 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:01.012914 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:01.014797 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":58,"threads_started":1}
W20260811 02:33:01.014937 1316 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:01.010344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:54133 (local address 127.17.79.62:46431)
0811 02:33:01.010429 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:01.010431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:01.010475 (+ 44us) server_negotiation.cc:407] Connection header received
0811 02:33:01.010533 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:01.010533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:01.010546 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:01.010583 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:01.010892 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.011399 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.012132 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.012336 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.012410 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:01.014869 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:54133: BlockingRecv error: recv got EOF from 127.17.79.3:54133 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 02:33:01 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:01 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:01.743067 1322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:01.737799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:39015)
0811 02:33:01.737983 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:01.737997 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:01.738073 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:01.738363 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:01.738364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:01.738533 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:01.738585 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:01.738587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.739307 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.739308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:01.739845 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:01.739847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.740238 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.740239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:01.740322 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:01.740939 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:01.740944 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:01.742976 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":81,"threads_started":1}
W20260811 02:33:01.743182 1324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:01.737863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:39015 (local address 127.17.79.62:46431)
0811 02:33:01.738034 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:01.738036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:01.738048 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:33:01.738207 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:01.738208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:01.738221 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:01.738333 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:01.738681 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.739215 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.739932 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.740129 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.740194 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:01.743104 (+ 2910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:39015: BlockingRecv error: recv got EOF from 127.17.79.1:39015 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":106,"threads_started":1}
Aug 11 02:33:01 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:01 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:01.880874 1326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:01.875830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:37941)
0811 02:33:01.876034 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:01.876048 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:01.876154 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:01.876344 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:01.876346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:01.876525 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:01.876574 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:01.876575 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.877287 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.877289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:01.877817 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:01.877819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.878185 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.878186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:01.878286 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:01.878835 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:01.878841 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:01.880809 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":117,"threads_started":1}
W20260811 02:33:01.881002 1324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:01.875916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:37941 (local address 127.17.79.62:46431)
0811 02:33:01.876030 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:01.876032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:01.876136 (+ 104us) server_negotiation.cc:407] Connection header received
0811 02:33:01.876252 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:01.876252 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:01.876268 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:01.876337 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:01.876662 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.877183 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.877919 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:01.878112 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:01.878187 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:01.880900 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:37941: BlockingRecv error: recv got EOF from 127.17.79.2:37941 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 02:33:02 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:02 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:02.020251 1329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:02.015402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:49945)
0811 02:33:02.015544 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:02.015557 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:02.015641 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:02.015803 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:02.015804 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:02.015989 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:02.016037 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:02.016039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.016755 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.016756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:02.017287 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:02.017289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.017673 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.017674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:02.017733 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:02.018247 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:02.018251 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:02.020151 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
W20260811 02:33:02.020306 1324 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:02.015555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:49945 (local address 127.17.79.62:46431)
0811 02:33:02.015627 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:02.015629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:02.015639 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:33:02.015701 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:02.015702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:02.015730 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:02.015795 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:02.016122 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.016661 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.017380 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.017566 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.017673 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:02.020237 (+ 2564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:49945: BlockingRecv error: recv got EOF from 127.17.79.3:49945 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 02:33:02 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:02 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:02.748538 1332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:02.743694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:41017)
0811 02:33:02.743862 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:02.743874 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:02.743933 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:02.744181 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:02.744183 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:02.744453 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:02.744519 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:02.744523 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.745238 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.745239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:02.745758 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:02.745759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.746134 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.746135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:02.746186 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:02.746745 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:02.746751 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:02.748480 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":78,"threads_started":1}
W20260811 02:33:02.748699 1333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:02.743781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:41017 (local address 127.17.79.62:46431)
0811 02:33:02.743914 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:02.743916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:02.743926 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:33:02.744038 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:02.744039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:02.744052 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:02.744142 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:02.744619 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.745159 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.745837 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.746021 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.746077 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:02.748610 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:41017: BlockingRecv error: recv got EOF from 127.17.79.1:41017 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
Aug 11 02:33:02 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:02 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:02.886991 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:02.881458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:56889)
0811 02:33:02.881686 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:02.881699 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:02.881780 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:02.881951 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:02.881952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:02.882152 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:02.882203 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:02.882205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.882937 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.882938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:02.883466 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:02.883467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.883836 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.883837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:02.883895 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:02.884541 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:02.884545 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:02.886888 (+ 2343us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":111,"threads_started":1}
W20260811 02:33:02.887051 1333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:02.881580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:56889 (local address 127.17.79.62:46431)
0811 02:33:02.881672 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:02.881675 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:02.881756 (+ 81us) server_negotiation.cc:407] Connection header received
0811 02:33:02.881843 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:02.881844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:02.881860 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:02.881929 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:02.882342 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.882847 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.883565 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:02.883760 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:02.883839 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:02.886981 (+ 3142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:56889: BlockingRecv error: recv got EOF from 127.17.79.2:56889 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 02:33:03 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:03 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:03.026326 1335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:03.020916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:50471)
0811 02:33:03.021234 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:03.021257 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:03.021419 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:03.021586 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:03.021587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:03.021829 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:03.021890 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:03.021893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.022590 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.022592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:03.023213 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:03.023215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.023589 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.023590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:03.023641 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:03.024182 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:03.024187 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:03.026190 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":101,"threads_started":1}
W20260811 02:33:03.026358 1333 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:03.020978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:50471 (local address 127.17.79.62:46431)
0811 02:33:03.021062 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:03.021064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:03.021415 (+ 351us) server_negotiation.cc:407] Connection header received
0811 02:33:03.021498 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:03.021499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:03.021512 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:03.021565 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:03.021969 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.022498 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.023305 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.023487 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.023548 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:03.026290 (+ 2742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:50471: BlockingRecv error: recv got EOF from 127.17.79.3:50471 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 02:33:03 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:03 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:03.754381 1336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:03.749238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:44351)
0811 02:33:03.749486 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:03.749500 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:03.749574 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:03.749734 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:03.749735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:03.749907 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:03.749959 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:03.749960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.750689 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.750691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:03.751232 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:03.751233 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.751672 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.751674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:03.751737 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:03.752405 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:03.752410 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:03.754247 (+ 1837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":143,"threads_started":1}
W20260811 02:33:03.754443 1340 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:03.749360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:44351 (local address 127.17.79.62:46431)
0811 02:33:03.749503 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:03.749505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:03.749602 (+ 97us) server_negotiation.cc:407] Connection header received
0811 02:33:03.749635 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:03.749636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:03.749649 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:03.749716 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:03.750055 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.750603 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.751322 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.751554 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.751666 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:03.754358 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:44351: BlockingRecv error: recv got EOF from 127.17.79.1:44351 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
Aug 11 02:33:03 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:03 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:03.897068 1342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:03.887689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:57515)
0811 02:33:03.887851 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:03.887885 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:03.887953 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:03.888130 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:03.888131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:03.888331 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:03.888383 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:03.888385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.889194 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.889195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:03.889736 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:03.889737 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.890183 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.890185 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:03.890251 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:03.894758 (+ 4507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:03.894763 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:03.897006 (+ 2243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
W20260811 02:33:03.897457 1340 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:03.887795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:57515 (local address 127.17.79.62:46431)
0811 02:33:03.887860 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:03.887862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:03.887948 (+ 86us) server_negotiation.cc:407] Connection header received
0811 02:33:03.888012 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:03.888013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:03.888026 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:03.888086 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:03.888491 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.889107 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.889835 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:03.890036 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:03.890113 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:03.897385 (+ 7272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:57515: BlockingRecv error: recv got EOF from 127.17.79.2:57515 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 02:33:04 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:04 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:04.031992 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:04.027007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:36541)
0811 02:33:04.027217 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:04.027227 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:04.027307 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:04.027472 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:04.027473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:04.027669 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:04.027716 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:04.027718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.028396 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.028397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:04.028920 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:04.028921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.029291 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.029292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:04.029351 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:04.029864 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:04.029868 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:04.031933 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":102,"threads_started":1}
W20260811 02:33:04.032212 1340 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:04.027074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:36541 (local address 127.17.79.62:46431)
0811 02:33:04.027156 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:04.027158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:04.027288 (+ 130us) server_negotiation.cc:407] Connection header received
0811 02:33:04.027375 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:04.027376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:04.027398 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:04.027463 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:04.027807 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.028310 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.029007 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.029197 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.029291 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:04.032124 (+ 2833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:36541: BlockingRecv error: recv got EOF from 127.17.79.3:36541 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 02:33:04 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:04 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
W20260811 02:33:04.761123 1347 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:04.755097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:50549 (local address 127.17.79.62:46431)
0811 02:33:04.755247 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:04.755249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:04.755424 (+ 175us) server_negotiation.cc:407] Connection header received
0811 02:33:04.755458 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:04.755459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:04.755472 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:04.755538 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:04.755927 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.756573 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.757492 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.757696 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.757773 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:04.761065 (+ 3292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:50549: BlockingRecv error: recv got EOF from 127.17.79.1:50549 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260811 02:33:04.761234 1345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:04.754966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:50549)
0811 02:33:04.755129 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:04.755142 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:04.755412 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:04.755564 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:04.755565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:04.755747 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:04.755797 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:04.755799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.756696 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.756698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:04.757386 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:04.757391 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.757804 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.757805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:04.757853 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:04.758572 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:04.758582 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:04.760987 (+ 2405us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
Aug 11 02:33:04 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:04 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:04.902643 1348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:04.897744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:46583)
0811 02:33:04.897888 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:04.897902 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:04.897957 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:04.898171 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:04.898172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:04.898364 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:04.898415 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:04.898417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.899115 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.899116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:04.899646 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:04.899648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.899972 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.899973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:04.900012 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:04.900443 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:04.900448 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:04.902575 (+ 2127us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
W20260811 02:33:04.902755 1347 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:04.897882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:46583 (local address 127.17.79.62:46431)
0811 02:33:04.897934 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:04.897938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:04.897948 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:33:04.898072 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:04.898073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:04.898089 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:04.898151 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:04.898511 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.899027 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.899725 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:04.899906 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:04.899961 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:04.902678 (+ 2717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:46583: BlockingRecv error: recv got EOF from 127.17.79.2:46583 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 11 02:33:05 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:05 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:05.037551 1350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:05.032489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:35389)
0811 02:33:05.032725 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:05.032739 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:05.032826 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:05.033045 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:05.033046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:05.033264 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:05.033316 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:05.033318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.034021 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.034022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:05.034609 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:05.034611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.035033 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.035034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:05.035103 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:05.035639 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:05.035644 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:05.037452 (+ 1808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":151,"threads_started":1}
W20260811 02:33:05.037607 1347 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:05.032588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:35389 (local address 127.17.79.62:46431)
0811 02:33:05.032701 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:05.032703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:05.032818 (+ 115us) server_negotiation.cc:407] Connection header received
0811 02:33:05.032911 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:05.032912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:05.032930 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:05.033014 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:05.033407 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.033918 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.034719 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.034911 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.035012 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:05.037538 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:35389: BlockingRecv error: recv got EOF from 127.17.79.3:35389 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 02:33:05 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:05 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:05.766525 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:05.761690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:42177)
0811 02:33:05.761879 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:05.761897 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:05.762005 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:05.762255 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:05.762256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:05.762475 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:05.762527 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:05.762529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.763171 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.763172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:05.763699 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:05.763700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.764018 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.764019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:05.764064 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:05.764551 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:05.764555 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:05.766424 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":75,"threads_started":1}
W20260811 02:33:05.766582 1352 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:05.761764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:42177 (local address 127.17.79.62:46431)
0811 02:33:05.761882 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:05.761884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:05.762096 (+ 212us) server_negotiation.cc:407] Connection header received
0811 02:33:05.762126 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:05.762127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:05.762141 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:05.762220 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:05.762603 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.763098 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.763770 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.763953 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.764003 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:05.766504 (+ 2501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:42177: BlockingRecv error: recv got EOF from 127.17.79.1:42177 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":51,"threads_started":1}
Aug 11 02:33:05 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:05 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:05.908291 1354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:05.903238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:34651)
0811 02:33:05.903450 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:05.903461 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:05.903510 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:05.903652 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:05.903652 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:05.903815 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:05.903865 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:05.903866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.904539 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.904540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:05.905090 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:05.905091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.905459 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.905460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:05.905504 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:05.906095 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:05.906100 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:05.908190 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":157,"threads_started":1}
W20260811 02:33:05.908344 1352 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:05.903445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:34651 (local address 127.17.79.62:46431)
0811 02:33:05.903526 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:05.903527 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:05.903538 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:33:05.903561 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:05.903561 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:05.903574 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:05.903638 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:05.903960 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.904462 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.905194 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:05.905383 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:05.905445 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:05.908275 (+ 2830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:34651: BlockingRecv error: recv got EOF from 127.17.79.2:34651 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 02:33:06 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:06 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:06.043108 1355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:06.038078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:46307)
0811 02:33:06.038290 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:06.038301 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:06.038366 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:06.038525 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:06.038526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:06.038691 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:06.038742 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:06.038743 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.039389 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.039390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:06.039936 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:06.039938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.040427 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.040428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:06.040474 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:06.040970 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:06.040974 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:06.043029 (+ 2055us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":105,"threads_started":1}
W20260811 02:33:06.043277 1352 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:06.038204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:46307 (local address 127.17.79.62:46431)
0811 02:33:06.038311 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:06.038313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:06.038351 (+ 38us) server_negotiation.cc:407] Connection header received
0811 02:33:06.038428 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:06.038429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:06.038444 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:06.038512 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:06.038808 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.039308 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.040045 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.040254 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.040416 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:06.043176 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:46307: BlockingRecv error: recv got EOF from 127.17.79.3:46307 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 02:33:06 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:06 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:06.772778 1357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:06.767115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:39077)
0811 02:33:06.767284 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:06.767302 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:06.767379 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:06.767540 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:06.767541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:06.767723 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:06.767775 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:06.767777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.768905 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.768906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:06.769460 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:06.769461 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.769996 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.769997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:06.770047 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:06.770603 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:06.770609 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:06.772676 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":63,"threads_started":1}
W20260811 02:33:06.772836 1358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:06.767236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:39077 (local address 127.17.79.62:46431)
0811 02:33:06.767403 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:06.767405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:06.767414 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:33:06.767445 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:06.767445 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:06.767456 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:06.767523 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:06.767982 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.768705 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.769591 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.769895 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.769973 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:06.772761 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:39077: BlockingRecv error: recv got EOF from 127.17.79.1:39077 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":73,"threads_started":1}
Aug 11 02:33:06 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:06 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:06.913861 1361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:06.908838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:35049)
0811 02:33:06.909050 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:06.909065 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:06.909158 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:06.909331 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:06.909332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:06.909512 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:06.909567 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:06.909569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.910331 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.910332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:06.910856 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:06.910858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.911252 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.911253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:06.911317 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:06.911803 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:06.911808 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:06.913800 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":118,"threads_started":1}
W20260811 02:33:06.914031 1358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:06.908956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:35049 (local address 127.17.79.62:46431)
0811 02:33:06.909071 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:06.909073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:06.909139 (+ 66us) server_negotiation.cc:407] Connection header received
0811 02:33:06.909248 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:06.909249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:06.909261 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:06.909316 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:06.909651 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.910167 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.910944 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:06.911159 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:06.911249 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:06.913939 (+ 2690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:35049: BlockingRecv error: recv got EOF from 127.17.79.2:35049 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 02:33:07 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:07 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:07.048759 1362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:07.043742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:40603)
0811 02:33:07.043958 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:07.043970 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:07.044045 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:07.044223 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:07.044224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:07.044420 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:07.044468 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:07.044469 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.045152 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.045153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:07.045684 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:07.045686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.046061 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.046062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:07.046121 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:07.046687 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:07.046692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:07.048663 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":112,"threads_started":1}
W20260811 02:33:07.048821 1358 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:07.043845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:40603 (local address 127.17.79.62:46431)
0811 02:33:07.043936 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:07.043939 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:07.044040 (+ 101us) server_negotiation.cc:407] Connection header received
0811 02:33:07.044108 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:07.044110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:07.044125 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:07.044215 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:07.044551 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.045057 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.045770 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.045954 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.046061 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:07.048754 (+ 2693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:40603: BlockingRecv error: recv got EOF from 127.17.79.3:40603 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 02:33:07 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:07 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:07.778028 1363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:07.773304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:41415)
0811 02:33:07.773464 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:07.773479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:07.773549 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:07.773735 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:07.773736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:07.773906 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:07.773957 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:07.773959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.774651 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.774652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:07.775197 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:07.775199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.775582 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.775583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:07.775635 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:07.776114 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:07.776119 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:07.777969 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":76,"threads_started":1}
W20260811 02:33:07.778183 1366 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:07.773440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:41415 (local address 127.17.79.62:46431)
0811 02:33:07.773597 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:07.773599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:07.773618 (+ 19us) server_negotiation.cc:407] Connection header received
0811 02:33:07.773640 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:07.773641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:07.773652 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:07.773719 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:07.774034 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.774562 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.775301 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.775492 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.775564 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:07.778093 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:41415: BlockingRecv error: recv got EOF from 127.17.79.1:41415 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":80,"threads_started":1}
Aug 11 02:33:07 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:07 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:07.919353 1368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:07.914422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:59031)
0811 02:33:07.914552 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:07.914571 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:07.914622 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:07.914753 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:07.914754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:07.914921 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:07.914971 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:07.914972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.915894 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.915895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:07.916431 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:07.916432 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.916773 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.916774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:07.916814 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:07.917285 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:07.917290 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:07.919253 (+ 1963us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
W20260811 02:33:07.919404 1366 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:07.914533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:59031 (local address 127.17.79.62:46431)
0811 02:33:07.914604 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:07.914606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:07.914615 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:33:07.914671 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:07.914671 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:07.914682 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:07.914740 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:07.915061 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.915813 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.916516 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:07.916706 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:07.916763 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:07.919335 (+ 2572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:59031: BlockingRecv error: recv got EOF from 127.17.79.2:59031 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 02:33:08 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:08 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:08.053833 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:08.049348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:46343)
0811 02:33:08.049526 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:08.049537 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:08.049603 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:08.049736 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:08.049737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:08.049906 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:08.049955 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:08.049957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.050629 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.050630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:08.051161 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:08.051163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.051479 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.051480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:08.051519 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:08.051958 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:08.051962 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:08.053773 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":119,"threads_started":1}
W20260811 02:33:08.053954 1366 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:08.049430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:46343 (local address 127.17.79.62:46431)
0811 02:33:08.049479 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:08.049481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:08.049608 (+ 127us) server_negotiation.cc:407] Connection header received
0811 02:33:08.049656 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:08.049657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:08.049670 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:08.049711 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:08.050020 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.050549 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.051238 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.051411 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.051469 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:08.053873 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:46343: BlockingRecv error: recv got EOF from 127.17.79.3:46343 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 11 02:33:08 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:08 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:08.783154 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:08.778556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:45125)
0811 02:33:08.778719 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:08.778732 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:08.778803 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:08.778940 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:08.778941 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:08.779128 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:08.779180 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:08.779181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.779820 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.779821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:08.780361 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:08.780362 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.780720 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.780721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:08.780772 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:08.781241 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:08.781245 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:08.783075 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":74,"threads_started":1}
W20260811 02:33:08.783243 1372 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:08.778615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:45125 (local address 127.17.79.62:46431)
0811 02:33:08.778747 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:08.778749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:08.778786 (+ 37us) server_negotiation.cc:407] Connection header received
0811 02:33:08.778847 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:08.778848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:08.778858 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:08.778917 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:08.779253 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.779746 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.780433 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.780631 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.780687 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:08.783164 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:45125: BlockingRecv error: recv got EOF from 127.17.79.1:45125 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
Aug 11 02:33:08 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:08 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:08.927930 1374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:08.919875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:41557)
0811 02:33:08.920009 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:08.920019 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:08.920069 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:08.920265 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:08.920265 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:08.920426 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:08.920475 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:08.920476 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.921172 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.921173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:08.921752 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:08.921753 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.922163 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.922164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:08.922208 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:08.925641 (+ 3433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:08.925646 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:08.927826 (+ 2180us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
W20260811 02:33:08.927982 1372 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:08.919954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:41557 (local address 127.17.79.62:46431)
0811 02:33:08.920121 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:08.920123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:08.920134 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:33:08.920170 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:08.920170 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:08.920184 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:08.920247 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:08.920542 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.921055 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.921833 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:08.922050 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:08.922173 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:08.927913 (+ 5740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:41557: BlockingRecv error: recv got EOF from 127.17.79.2:41557 (error 108)
Metrics: {"server-negotiator.queue_time_us":138}
Aug 11 02:33:09 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:09 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:09.059186 1376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:09.054420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:48013)
0811 02:33:09.054581 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:09.054595 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:09.054668 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:09.054822 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:09.054823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:09.054995 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:09.055045 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:09.055046 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.055806 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.055807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:09.056356 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:09.056358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.056690 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.056691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:09.056730 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:09.057335 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:09.057341 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:09.059127 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":61,"threads_started":1}
W20260811 02:33:09.059345 1372 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:09.054549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:48013 (local address 127.17.79.62:46431)
0811 02:33:09.054635 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:09.054636 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:09.054654 (+ 18us) server_negotiation.cc:407] Connection header received
0811 02:33:09.054728 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:09.054729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:09.054744 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:09.054800 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:09.055105 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.055697 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.056440 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.056617 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.056675 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:09.059238 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:48013: BlockingRecv error: recv got EOF from 127.17.79.3:48013 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 02:33:09 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:09 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:09.788465 1377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:09.783695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:55945)
0811 02:33:09.783846 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:09.783857 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:09.783908 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:09.784059 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:09.784060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:09.784238 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:09.784288 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:09.784289 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.784958 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.784959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:09.785482 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:09.785483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.785850 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.785851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:09.785894 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:09.786442 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:09.786447 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:09.788402 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
W20260811 02:33:09.788614 1378 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:09.783788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:55945 (local address 127.17.79.62:46431)
0811 02:33:09.783932 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:09.783934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:09.783942 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:33:09.783964 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:09.783965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:09.783975 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:09.784039 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:09.784371 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.784880 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.785576 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.785771 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.785836 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:09.788522 (+ 2686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:55945: BlockingRecv error: recv got EOF from 127.17.79.1:55945 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
Aug 11 02:33:09 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:09 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:09.933905 1379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:09.928495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:43705)
0811 02:33:09.928667 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:09.928679 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:09.928739 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:09.928963 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:09.928965 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:09.929140 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:09.929190 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:09.929192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.929885 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.929886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:09.930492 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:09.930494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.930860 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.930861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:09.930910 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:09.931461 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:09.931467 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:09.933804 (+ 2337us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
W20260811 02:33:09.933964 1378 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:09.928600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:43705 (local address 127.17.79.62:46431)
0811 02:33:09.928745 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:09.928751 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:09.928763 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:33:09.928790 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:09.928791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:09.928802 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:09.928875 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:09.929292 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.929789 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.930586 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:09.930774 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:09.930836 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:09.933897 (+ 3061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:43705: BlockingRecv error: recv got EOF from 127.17.79.2:43705 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 11 02:33:10 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:10 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:10.064764 1382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:10.059755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:32983)
0811 02:33:10.059900 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:10.059916 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:10.059998 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:10.060165 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:10.060166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:10.060357 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:10.060404 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:10.060406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.061149 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.061151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:10.061745 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:10.061747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.062189 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.062190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:10.062278 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:10.062858 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:10.062863 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:10.064693 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
W20260811 02:33:10.064841 1378 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:10.059931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:32983 (local address 127.17.79.62:46431)
0811 02:33:10.060001 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:10.060002 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:10.060014 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:33:10.060067 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:10.060068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:10.060086 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:10.060142 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:10.060480 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.061069 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.061831 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.062100 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.062182 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:10.064791 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:32983: BlockingRecv error: recv got EOF from 127.17.79.3:32983 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 02:33:10 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:10 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:10.793615 1385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:10.788913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:39183)
0811 02:33:10.789090 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:10.789107 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:10.789174 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:10.789351 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:10.789353 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:10.789534 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:10.789586 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:10.789587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.790270 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.790271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:10.790812 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:10.790814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.791174 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.791176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:10.791227 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:10.791690 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:10.791695 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:10.793543 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
W20260811 02:33:10.793722 1386 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:10.788963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:39183 (local address 127.17.79.62:46431)
0811 02:33:10.789111 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:10.789113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:10.789157 (+ 44us) server_negotiation.cc:407] Connection header received
0811 02:33:10.789219 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:10.789219 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:10.789230 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:10.789300 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:10.789664 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.790156 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.790881 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.791059 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.791112 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:10.793650 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:39183: BlockingRecv error: recv got EOF from 127.17.79.1:39183 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
Aug 11 02:33:10 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:10 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:10.939353 1387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:10.934442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:53069)
0811 02:33:10.934600 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:10.934610 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:10.934670 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:10.934819 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:10.934820 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:10.934997 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:10.935051 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:10.935053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.935788 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.935789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:10.936421 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:10.936424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.936800 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.936801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:10.936852 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:10.937370 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:10.937374 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:10.939280 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
W20260811 02:33:10.939653 1386 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:10.934550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:53069 (local address 127.17.79.62:46431)
0811 02:33:10.934619 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:10.934621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:10.934660 (+ 39us) server_negotiation.cc:407] Connection header received
0811 02:33:10.934740 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:10.934741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:10.934753 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:10.934806 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:10.935178 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.935676 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.936521 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:10.936712 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:10.936774 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:10.939571 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:53069: BlockingRecv error: recv got EOF from 127.17.79.2:53069 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 02:33:11 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:11 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:11.071532 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:11.065552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:59629)
0811 02:33:11.065805 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:11.065820 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:11.065929 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:11.066089 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:11.066090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:11.066590 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:11.066669 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:11.066675 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.067545 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.067546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:11.068098 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:11.068100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.068478 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.068479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:11.068539 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:11.069099 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:11.069104 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:11.071467 (+ 2363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":113,"threads_started":1}
W20260811 02:33:11.071703 1386 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:11.065677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:59629 (local address 127.17.79.62:46431)
0811 02:33:11.065787 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:11.065790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:11.065906 (+ 116us) server_negotiation.cc:407] Connection header received
0811 02:33:11.065996 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:11.065998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:11.066015 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:11.066074 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:11.066919 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.067448 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.068204 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.068395 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.068465 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:11.071611 (+ 3146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:59629: BlockingRecv error: recv got EOF from 127.17.79.3:59629 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 11 02:33:11 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:11 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:11.799870 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:11.794305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:46059)
0811 02:33:11.794583 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:11.794597 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:11.794673 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:11.794917 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:11.794918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:11.795187 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:11.795241 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:11.795243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.796052 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.796054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:11.797174 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:11.797177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.797534 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.797535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:11.797580 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:11.798058 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:11.798062 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:11.799810 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":118,"threads_started":1}
W20260811 02:33:11.800019 1394 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:11.794383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:46059 (local address 127.17.79.62:46431)
0811 02:33:11.794500 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:11.794502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:11.794659 (+ 157us) server_negotiation.cc:407] Connection header received
0811 02:33:11.794788 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:11.794789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:11.794805 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:11.794866 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:11.795378 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.795973 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.797263 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.797461 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.797526 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:11.799924 (+ 2398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:46059: BlockingRecv error: recv got EOF from 127.17.79.1:46059 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":49,"threads_started":1}
Aug 11 02:33:11 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:11 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:11.944854 1395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:11.939833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:53897)
0811 02:33:11.940064 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:11.940143 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:11.940250 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:11.940434 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:11.940435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:11.940650 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:11.940698 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:11.940700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.941370 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.941372 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:11.941897 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:11.941898 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.942300 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.942301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:11.942373 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:11.942875 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:11.942880 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:11.944792 (+ 1912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":119,"threads_started":1}
W20260811 02:33:11.945000 1394 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:11.939938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:53897 (local address 127.17.79.62:46431)
0811 02:33:11.940035 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:11.940038 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:11.940234 (+ 196us) server_negotiation.cc:407] Connection header received
0811 02:33:11.940325 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:11.940326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:11.940344 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:11.940424 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:11.940780 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.941286 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.941983 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:11.942187 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:11.942299 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:11.944907 (+ 2608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:53897: BlockingRecv error: recv got EOF from 127.17.79.2:53897 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 02:33:12 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:12 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:12.078056 1396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:12.072194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:53709)
0811 02:33:12.072432 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:12.072445 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:12.072524 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:12.072670 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:12.072671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:12.072861 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:12.072909 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:12.072910 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.073628 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.073629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:12.074349 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:12.074353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.074752 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.074753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:12.074803 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:12.075639 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:12.075646 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:12.077975 (+ 2329us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":124,"threads_started":1}
W20260811 02:33:12.078223 1394 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:12.072293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:53709 (local address 127.17.79.62:46431)
0811 02:33:12.072386 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:12.072389 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:12.072516 (+ 127us) server_negotiation.cc:407] Connection header received
0811 02:33:12.072589 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:12.072590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:12.072607 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:12.072664 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:12.072997 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.073534 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.074457 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.074663 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.074729 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:12.078069 (+ 3340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:53709: BlockingRecv error: recv got EOF from 127.17.79.3:53709 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 02:33:12 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:12 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:12.805804 1397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:12.800431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:55717)
0811 02:33:12.800601 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:12.800612 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:12.800664 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:12.800847 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:12.800848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:12.801022 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:12.801092 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:12.801094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.801880 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.801882 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:12.802627 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:12.802631 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.803051 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.803052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:12.803111 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:12.803642 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:12.803649 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:12.805734 (+ 2085us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":97,"threads_started":1}
W20260811 02:33:12.805902 1398 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:12.800538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:55717 (local address 127.17.79.62:46431)
0811 02:33:12.800705 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:12.800707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:12.800716 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:33:12.800742 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:12.800743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:12.800755 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:12.800835 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:12.801218 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.801780 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.802737 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.802958 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.803037 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:12.805828 (+ 2791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:55717: BlockingRecv error: recv got EOF from 127.17.79.1:55717 (error 108)
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
Aug 11 02:33:12 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:12 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:12.954869 1401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:12.945548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:59661)
0811 02:33:12.945707 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:12.945741 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:12.945809 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:12.945968 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:12.945969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:12.946167 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:12.946212 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:12.946214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.946953 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.946954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:12.947531 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:12.947533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.947952 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.947953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:12.948028 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:12.952795 (+ 4767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:12.952800 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:12.954752 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":101,"threads_started":1}
W20260811 02:33:12.954945 1398 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:12.945700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:59661 (local address 127.17.79.62:46431)
0811 02:33:12.945777 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:12.945779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:12.945790 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:33:12.945891 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:12.945892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:12.945906 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:12.945952 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:12.946352 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.946854 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.947650 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:12.947859 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:12.947951 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:12.954877 (+ 6926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:59661: BlockingRecv error: recv got EOF from 127.17.79.2:59661 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 02:33:13 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:13 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:13.083235 1402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:13.078571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:56337)
0811 02:33:13.078752 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:13.078763 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:13.078820 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:13.078968 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:13.078968 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:13.079151 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:13.079199 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:13.079201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.079834 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.079835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:13.080347 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:13.080349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.080738 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.080739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:13.080808 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:13.081275 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:13.081279 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:13.083129 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":121,"threads_started":1}
W20260811 02:33:13.083379 1398 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:13.078646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:56337 (local address 127.17.79.62:46431)
0811 02:33:13.078733 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:13.078735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:13.078820 (+ 85us) server_negotiation.cc:407] Connection header received
0811 02:33:13.078888 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:13.078889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:13.078904 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:13.078952 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:13.079268 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.079769 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.080442 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.080663 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.080737 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:13.083306 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:56337: BlockingRecv error: recv got EOF from 127.17.79.3:56337 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 11 02:33:13 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:13 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:13.810906 1404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:13.806355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:51869)
0811 02:33:13.806540 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:13.806552 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:13.806608 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:13.806751 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:13.806752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:13.806924 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:13.806972 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:13.806973 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.807618 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.807619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:13.808151 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:13.808152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.808617 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.808618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:13.808662 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:13.809112 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:13.809116 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:13.810838 (+ 1722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":93,"threads_started":1}
W20260811 02:33:13.811046 1405 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:13.806460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:51869 (local address 127.17.79.62:46431)
0811 02:33:13.806595 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:13.806597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:13.806607 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:33:13.806658 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:13.806659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:13.806670 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:13.806731 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:13.807037 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.807549 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.808254 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.808545 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.808598 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:13.810953 (+ 2355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:51869: BlockingRecv error: recv got EOF from 127.17.79.1:51869 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
Aug 11 02:33:13 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:13 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:13.963783 1408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:13.955574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:48449)
0811 02:33:13.955762 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:13.955782 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:13.956004 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:13.956183 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:13.956185 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:13.956384 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:13.956436 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:13.956438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.957241 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.957242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:13.957802 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:13.957804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.958201 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.958202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:13.958311 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:13.961590 (+ 3279us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:13.961597 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:13.963712 (+ 2115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":107,"threads_started":1}
W20260811 02:33:13.963946 1405 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:13.955688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:48449 (local address 127.17.79.62:46431)
0811 02:33:13.955767 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:13.955770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:13.955969 (+ 199us) server_negotiation.cc:407] Connection header received
0811 02:33:13.956062 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:13.956063 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:13.956078 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:13.956143 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:13.956536 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.957037 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.957906 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:13.958111 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:13.958175 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:13.963867 (+ 5692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:48449: BlockingRecv error: recv got EOF from 127.17.79.2:48449 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 02:33:14 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:14 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.3@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:14.088583 1409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:14.083777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.3:52035)
0811 02:33:14.083951 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:14.083962 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:14.084056 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:14.084209 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:14.084210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:14.084400 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:14.084445 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:14.084447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.085111 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.085112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:14.085675 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:14.085677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.086033 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.086034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:14.086091 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:14.086588 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:14.086593 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:14.088520 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":74,"threads_started":1}
W20260811 02:33:14.088840 1405 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:14.083788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:52035 (local address 127.17.79.62:46431)
0811 02:33:14.083835 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:14.083838 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:14.084041 (+ 203us) server_negotiation.cc:407] Connection header received
0811 02:33:14.084130 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:14.084131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:14.084146 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:14.084192 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:14.084521 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.085024 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.085760 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.085949 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.086031 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:14.088610 (+ 2579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.3:52035: BlockingRecv error: recv got EOF from 127.17.79.3:52035 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 11 02:33:14 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:14 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.1@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:14.816083 1411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:14.811430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.1:44309)
0811 02:33:14.811593 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:14.811604 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:14.811658 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:14.811784 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:14.811785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:14.812034 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:14.812098 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:14.812101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.812815 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.812816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:14.813350 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:14.813352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.813688 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.813689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:14.813731 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:14.814199 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:14.814204 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:14.816016 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
W20260811 02:33:14.816226 1412 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:14.811529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:44309 (local address 127.17.79.62:46431)
0811 02:33:14.811655 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:14.811657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:14.811667 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:33:14.811699 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:14.811700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:14.811710 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:14.811770 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:14.812203 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.812727 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.813427 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.813621 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.813679 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:14.816116 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.1:44309: BlockingRecv error: recv got EOF from 127.17.79.1:44309 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":75,"threads_started":1}
Aug 11 02:33:14 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
Aug 11 02:33:14 dist-test-slave-7nm7 krb5kdc[32027](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.79.2@KRBTEST.COM for oryx/127.17.79.62@KRBTEST.COM, Server not found in Kerberos database
I20260811 02:33:14.969110 1413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:14.964315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46431 (local address 127.17.79.2:52495)
0811 02:33:14.964499 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:14.964513 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:14.964606 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:14.964798 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:14.964799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:14.964968 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:14.965018 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:14.965019 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.965690 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.965691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:14.966217 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:14.966218 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.966659 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.966661 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:14.966725 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:14.967185 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:14.967189 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:14.968999 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.79.62:46431: Server oryx/127.17.79.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":82,"threads_started":1}
W20260811 02:33:14.969161 1412 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:14.964413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:52495 (local address 127.17.79.62:46431)
0811 02:33:14.964498 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:14.964500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:14.964585 (+ 85us) server_negotiation.cc:407] Connection header received
0811 02:33:14.964683 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:14.964684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:14.964698 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:14.964778 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:14.965095 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.965593 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.966359 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:14.966551 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:14.966656 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:14.969090 (+ 2434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.79.2:52495: BlockingRecv error: recv got EOF from 127.17.79.2:52495 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 02:33:15.001893 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 597
I20260811 02:33:15.018621 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 867
I20260811 02:33:15.032892 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 1073
I20260811 02:33:15.046298 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 477
2026-08-11T02:33:15Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17800 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T02:33:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:33:15Z Disabled control of system clock
I20260811 02:33:15.086508 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36311
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:36311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 02:33:15.175932 1421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:15.176245 1421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:15.176290 1421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:15.177558 1421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:33:15.177601 1421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:15.177614 1421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:15.177627 1421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:33:15.177661 1421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:33:15.179061 1421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:36311
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:15.179275 1421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:15.179526 1421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:33:15.184787 1421 server_base.cc:1034] running on GCE node
W20260811 02:33:15.184715 1432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:15.184692 1435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:15.184687 1431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.185288 1421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:15.185580 1421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:15.186760 1421 hybrid_clock.cc:648] HybridClock initialized: now 1786415595186746 us; error 33 us; skew 500 ppm
I20260811 02:33:15.188091 1421 webserver.cc:460] Webserver started at http://127.17.79.62:34221/ using document root <none> and password file <none>
I20260811 02:33:15.188372 1421 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:15.188443 1421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:15.188583 1421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:15.189648 1421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "73484e69b9a24dabb4a68a9a28e1bcfe"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "8f0a08b438e1408c01ba7c1f83dc5d0b"
server_key_iv: "69f0a5f9bbbfbde3a4b56dfb466264c4"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.190017 1421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "73484e69b9a24dabb4a68a9a28e1bcfe"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "8f0a08b438e1408c01ba7c1f83dc5d0b"
server_key_iv: "69f0a5f9bbbfbde3a4b56dfb466264c4"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.191454 1421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:33:15.192247 1445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.192466 1421 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:15.192584 1421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "73484e69b9a24dabb4a68a9a28e1bcfe"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "8f0a08b438e1408c01ba7c1f83dc5d0b"
server_key_iv: "69f0a5f9bbbfbde3a4b56dfb466264c4"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.192668 1421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:15.203594 1421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:15.203904 1421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:15.204049 1421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:15.208298 1421 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:36311
I20260811 02:33:15.208338 1532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:36311 every 8 connection(s)
I20260811 02:33:15.208685 1421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:33:15.209408 1533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:33:15.211548 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 1421
I20260811 02:33:15.211663 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:33:15.211846 17724 external_mini_cluster.cc:1428] Setting key a520229e12cb6aa62b905635a9f67721
I20260811 02:33:15.212555 1533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe: Bootstrap starting.
I20260811 02:33:15.213249 1533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe: Neither blocks nor log segments found. Creating new log.
I20260811 02:33:15.213611 1533 log.cc:824] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe: Log is configured to *not* fsync() on all Append() calls
I20260811 02:33:15.214416 1533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe: No bootstrap required, opened a new log
I20260811 02:33:15.216358 1533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36311 } }
I20260811 02:33:15.216557 1533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:33:15.216617 1533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73484e69b9a24dabb4a68a9a28e1bcfe, State: Initialized, Role: FOLLOWER
I20260811 02:33:15.216751 1533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36311 } }
I20260811 02:33:15.216842 1533 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:33:15.216886 1533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:33:15.216941 1533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:33:15.217346 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.212377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50614 (local address 127.17.79.62:36311)
0811 02:33:15.212563 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:15.212570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:15.212595 (+ 25us) server_negotiation.cc:407] Connection header received
0811 02:33:15.213048 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:15.213054 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:15.213115 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:15.213230 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:15.213535 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.214484 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.215257 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.215673 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.215811 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:15.216597 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:15.216601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:15.216601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:15.216875 (+ 274us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:15.216917 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:15.216934 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:15.216990 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:15.217074 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 02:33:15.217157 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260811 02:33:15.217724 1533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36311 } }
I20260811 02:33:15.217847 1533 leader_election.cc:302] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73484e69b9a24dabb4a68a9a28e1bcfe; no voters:
I20260811 02:33:15.218041 1533 leader_election.cc:288] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:33:15.218075 1541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:33:15.218323 1541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [term 1 LEADER]: Becoming Leader. State: Replica: 73484e69b9a24dabb4a68a9a28e1bcfe, State: Running, Role: LEADER
I20260811 02:33:15.218333 1533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:33:15.218426 1541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36311 } }
I20260811 02:33:15.218773 1542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36311 } } }
I20260811 02:33:15.218783 1543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73484e69b9a24dabb4a68a9a28e1bcfe. Latest consensus state: current_term: 1 leader_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73484e69b9a24dabb4a68a9a28e1bcfe" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36311 } } }
I20260811 02:33:15.218973 1543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [sys.catalog]: This master's current role is: LEADER
I20260811 02:33:15.218904 1542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe [sys.catalog]: This master's current role is: LEADER
I20260811 02:33:15.219188 1552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:33:15.219681 1552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:33:15.221174 1552 catalog_manager.cc:1347] Generated new cluster ID: e131cd5d7f324d5f9b31d8f1ee569ae9
I20260811 02:33:15.221230 1552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:33:15.253028 1552 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:33:15.253752 1552 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:33:15.256891 1552 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73484e69b9a24dabb4a68a9a28e1bcfe: Generated new TSK 0
I20260811 02:33:15.257081 1552 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:33:15.261111 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36311
--builtin_ntp_servers=127.17.79.20:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 02:33:15.346089 1579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:15.346380 1579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:15.346421 1579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:15.347548 1579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:15.347618 1579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:15.347663 1579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:33:15.349030 1579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:15.349295 1579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:15.349612 1579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:15.354729 1590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:15.354712 1585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.354889 1579 server_base.cc:1034] running on GCE node
W20260811 02:33:15.354712 1586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.355185 1579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:15.355435 1579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:15.356594 1579 hybrid_clock.cc:648] HybridClock initialized: now 1786415595356580 us; error 29 us; skew 500 ppm
I20260811 02:33:15.357983 1579 webserver.cc:460] Webserver started at http://127.17.79.1:33719/ using document root <none> and password file <none>
I20260811 02:33:15.358377 1579 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:15.358448 1579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:15.358609 1579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:15.359701 1579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "bf402153d90a4e198c23452c77ef33c1"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "6da1c4868619efe07cb59636dd399404"
server_key_iv: "f598313586164a9ebc1cdfe1061f5132"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.360057 1579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "bf402153d90a4e198c23452c77ef33c1"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "6da1c4868619efe07cb59636dd399404"
server_key_iv: "f598313586164a9ebc1cdfe1061f5132"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.361616 1579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:33:15.362540 1604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.362762 1579 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:33:15.362847 1579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "bf402153d90a4e198c23452c77ef33c1"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "6da1c4868619efe07cb59636dd399404"
server_key_iv: "f598313586164a9ebc1cdfe1061f5132"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.362942 1579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:15.372017 1579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:15.372336 1579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:15.372490 1579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:15.372721 1579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:15.373067 1579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:15.373122 1579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.373163 1579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:15.373191 1579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.379907 1579 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:38157
I20260811 02:33:15.379956 1793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:38157 every 8 connection(s)
I20260811 02:33:15.380342 1579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:33:15.385630 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.381089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:49469 (local address 127.17.79.62:36311)
0811 02:33:15.381139 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:15.381141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:15.381465 (+ 324us) server_negotiation.cc:407] Connection header received
0811 02:33:15.381941 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:15.381942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:15.381952 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:15.382008 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:15.382746 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.383289 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.384269 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.384451 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.384510 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:15.385424 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:15.385425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:15.385425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:15.385430 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:15.385443 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:15.385446 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:15.385491 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:15.385548 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 02:33:15.385567 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:33:15.385857 1799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.381104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36311 (local address 127.17.79.1:49469)
0811 02:33:15.381344 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:15.381379 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:15.381859 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:15.382060 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:15.382064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:15.382072 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:15.382635 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:15.382640 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.383380 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.383381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:15.384187 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:15.384190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.384551 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.384553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:15.384688 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:15.385289 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:33:15.385290 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:15.385324 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:33:15.385346 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:15.385491 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:15.385493 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:15.385496 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:33:15.385541 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 02:33:15.385618 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":136,"threads_started":1}
I20260811 02:33:15.386492 1795 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36311
I20260811 02:33:15.386597 1795 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:15.386793 1795 heartbeater.cc:511] Master 127.17.79.62:36311 requested a full tablet report, sending...
I20260811 02:33:15.386827 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 1579
I20260811 02:33:15.386919 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:33:15.387166 17724 external_mini_cluster.cc:1428] Setting key 478beeacac33c5ca569fbc1cf713be2e
I20260811 02:33:15.387399 1477 ts_manager.cc:194] Registered new tserver with Master: bf402153d90a4e198c23452c77ef33c1 (127.17.79.1:38157)
I20260811 02:33:15.388212 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36311
--builtin_ntp_servers=127.17.79.20:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 02:33:15.388207 1477 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.1:49469
W20260811 02:33:15.479215 1801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:15.479633 1801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:15.479703 1801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:15.481810 1801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:15.481884 1801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:15.481933 1801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:33:15.483583 1801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:15.483904 1801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:15.484241 1801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:15.489799 1812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:15.489773 1809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.489856 1801 server_base.cc:1034] running on GCE node
W20260811 02:33:15.489771 1810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.490398 1801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:15.490674 1801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:15.491904 1801 hybrid_clock.cc:648] HybridClock initialized: now 1786415595491898 us; error 46 us; skew 500 ppm
I20260811 02:33:15.493501 1801 webserver.cc:460] Webserver started at http://127.17.79.2:44231/ using document root <none> and password file <none>
I20260811 02:33:15.493777 1801 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:15.493845 1801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:15.493994 1801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:15.495882 1801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "d8bc6f0360db462f996fe53a7692d9b7"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "473d71197e0e4faf5a2013bc16244011"
server_key_iv: "7b587137810933463b7615255095246c"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.496510 1801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "d8bc6f0360db462f996fe53a7692d9b7"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "473d71197e0e4faf5a2013bc16244011"
server_key_iv: "7b587137810933463b7615255095246c"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.498379 1801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 02:33:15.499315 1829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.499531 1801 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:15.499650 1801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "d8bc6f0360db462f996fe53a7692d9b7"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "473d71197e0e4faf5a2013bc16244011"
server_key_iv: "7b587137810933463b7615255095246c"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.499749 1801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:15.537022 1801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:15.537631 1801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:15.537817 1801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:15.538149 1801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:15.538666 1801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:15.538729 1801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.538754 1801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:15.538793 1801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.545200 1801 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:45187
I20260811 02:33:15.545236 2023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:45187 every 8 connection(s)
I20260811 02:33:15.545586 1801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:33:15.550701 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.546371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:39589 (local address 127.17.79.62:36311)
0811 02:33:15.546437 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:15.546440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:15.546705 (+ 265us) server_negotiation.cc:407] Connection header received
0811 02:33:15.547186 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:15.547187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:15.547198 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:15.547248 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:15.547878 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.548394 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.549390 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.549570 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.549632 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:15.550472 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:15.550473 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:15.550473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:15.550478 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:15.550492 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:15.550496 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:15.550536 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:15.550623 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 02:33:15.550643 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 02:33:15.550925 2027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.546373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36311 (local address 127.17.79.2:39589)
0811 02:33:15.546591 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:15.546625 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:15.547103 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:15.547308 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:15.547311 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:15.547320 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:15.547807 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:15.547811 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.548496 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.548497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:15.549309 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:15.549312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.549656 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.549657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:15.549765 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:15.550327 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:33:15.550328 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:15.550357 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:33:15.550378 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:15.550547 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:15.550551 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:15.550554 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:33:15.550607 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 02:33:15.550709 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":100,"threads_started":1}
I20260811 02:33:15.551411 2025 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36311
I20260811 02:33:15.551512 2025 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:15.551695 2025 heartbeater.cc:511] Master 127.17.79.62:36311 requested a full tablet report, sending...
I20260811 02:33:15.552037 1477 ts_manager.cc:194] Registered new tserver with Master: d8bc6f0360db462f996fe53a7692d9b7 (127.17.79.2:45187)
I20260811 02:33:15.552385 1477 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.2:39589
I20260811 02:33:15.554764 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 1801
I20260811 02:33:15.554862 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:33:15.555049 17724 external_mini_cluster.cc:1428] Setting key 6d175b3354246585700a39963c0e6a3b
I20260811 02:33:15.555963 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36311
--builtin_ntp_servers=127.17.79.20:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 02:33:15.639225 2028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:15.639467 2028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:15.639501 2028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:15.640646 2028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:15.640714 2028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:15.640759 2028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:33:15.642300 2028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:15.642563 2028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:15.642864 2028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:15.648464 2042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:15.648518 2046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.648679 2028 server_base.cc:1034] running on GCE node
W20260811 02:33:15.648716 2048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.648962 2028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:15.649245 2028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:15.650406 2028 hybrid_clock.cc:648] HybridClock initialized: now 1786415595650393 us; error 42 us; skew 500 ppm
I20260811 02:33:15.651671 2028 webserver.cc:460] Webserver started at http://127.17.79.3:33299/ using document root <none> and password file <none>
I20260811 02:33:15.651904 2028 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:15.651969 2028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:15.652125 2028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:15.653188 2028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "774ad82460c6401e88f9aa048bd0d5f3"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "fc15266dcdbaa2a5bc94b3f0c94742c1"
server_key_iv: "ed8c657f5559c7f67a59b313e66641a9"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.653555 2028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "774ad82460c6401e88f9aa048bd0d5f3"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "fc15266dcdbaa2a5bc94b3f0c94742c1"
server_key_iv: "ed8c657f5559c7f67a59b313e66641a9"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.655007 2028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:33:15.655782 2054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.655997 2028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:15.656188 2028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "774ad82460c6401e88f9aa048bd0d5f3"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "fc15266dcdbaa2a5bc94b3f0c94742c1"
server_key_iv: "ed8c657f5559c7f67a59b313e66641a9"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.656273 2028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:15.680756 2028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:15.681128 2028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:15.681286 2028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:15.681577 2028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:15.681943 2028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:15.681996 2028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.682039 2028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:15.682067 2028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.688090 2028 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39595
I20260811 02:33:15.688143 2255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39595 every 8 connection(s)
I20260811 02:33:15.688485 2028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:33:15.691844 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 2028
I20260811 02:33:15.691954 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:33:15.692211 17724 external_mini_cluster.cc:1428] Setting key d63f0c47e790888f96be99dae36d68eb
I20260811 02:33:15.694468 1536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.689258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:54905 (local address 127.17.79.62:36311)
0811 02:33:15.689325 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:15.689328 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:15.689586 (+ 258us) server_negotiation.cc:407] Connection header received
0811 02:33:15.690092 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:15.690093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:15.690113 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:15.690178 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:15.690932 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.691604 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.692949 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.693242 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.693311 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:15.694164 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:15.694166 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:15.694166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:15.694170 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:15.694186 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:15.694190 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:15.694325 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:15.694389 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 02:33:15.694410 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 02:33:15.694711 2266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.689244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36311 (local address 127.17.79.3:54905)
0811 02:33:15.689461 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:15.689496 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:15.689972 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:15.690300 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:15.690304 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:15.690315 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:15.690832 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:15.690836 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.691739 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.691740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:15.692863 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:15.692867 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:15.693332 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:15.693333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:15.693443 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:15.694010 (+ 567us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:33:15.694011 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:15.694038 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:33:15.694061 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:15.694330 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:15.694335 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:15.694337 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:33:15.694391 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 02:33:15.694471 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":106,"threads_started":1}
I20260811 02:33:15.695329 2256 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36311
I20260811 02:33:15.695420 2256 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:15.695604 2256 heartbeater.cc:511] Master 127.17.79.62:36311 requested a full tablet report, sending...
I20260811 02:33:15.696027 1477 ts_manager.cc:194] Registered new tserver with Master: 774ad82460c6401e88f9aa048bd0d5f3 (127.17.79.3:39595)
I20260811 02:33:15.696458 1477 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.3:54905
I20260811 02:33:15.703998 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 02:33:15.705994 1536 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:15.705535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50618 (local address 127.17.79.62:36311)
0811 02:33:15.705596 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:15.705598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:15.705689 (+ 91us) server_negotiation.cc:407] Connection header received
0811 02:33:15.705731 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:15.705731 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:15.705741 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:15.705791 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:15.705908 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50618: BlockingRecv error: recv got EOF from 127.0.0.1:50618 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 02:33:15.706084 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 1579
I20260811 02:33:15.717917 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 1801
I20260811 02:33:15.724781 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 2028
I20260811 02:33:15.753629 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 1421
2026-08-11T02:33:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (703 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T02:33:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:33:15Z Disabled control of system clock
I20260811 02:33:15.788434 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33819
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:33819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 02:33:15.873265 2282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:15.873502 2282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:15.873525 2282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:15.874629 2282 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:33:15.874665 2282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:15.874677 2282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:15.874691 2282 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:33:15.874702 2282 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:33:15.876036 2282 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:33819
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2282
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:15.876240 2282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:15.876477 2282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:15.881584 2289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:15.881615 2288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:15.881614 2291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:15.881848 2282 server_base.cc:1034] running on GCE node
I20260811 02:33:15.882114 2282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:15.882473 2282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:15.883680 2282 hybrid_clock.cc:648] HybridClock initialized: now 1786415595883663 us; error 56 us; skew 500 ppm
I20260811 02:33:15.885082 2282 webserver.cc:460] Webserver started at http://127.17.79.62:39737/ using document root <none> and password file <none>
I20260811 02:33:15.885347 2282 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:15.885417 2282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:15.885556 2282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:15.886689 2282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "c33ace6a3d0f4326b0575eaf1880d8f1"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "22900916100327f061e4154f02925d94"
server_key_iv: "4831c8e1bfae9bf2870a0430db7ea06a"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.887634 2282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "c33ace6a3d0f4326b0575eaf1880d8f1"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "22900916100327f061e4154f02925d94"
server_key_iv: "4831c8e1bfae9bf2870a0430db7ea06a"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.889393 2282 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:33:15.890304 2299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:15.890477 2282 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:15.890586 2282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "c33ace6a3d0f4326b0575eaf1880d8f1"
format_stamp: "Formatted at 2026-08-11 02:33:15 on dist-test-slave-7nm7"
server_key: "22900916100327f061e4154f02925d94"
server_key_iv: "4831c8e1bfae9bf2870a0430db7ea06a"
server_key_version: "encryptionkey@0"
I20260811 02:33:15.890669 2282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:15.894809 2282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:15.895175 2282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:15.895427 2282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:15.899284 2282 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:33819
I20260811 02:33:15.899333 2383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:33819 every 8 connection(s)
I20260811 02:33:15.899664 2282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:33:15.900373 2384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:33:15.903185 2384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1: Bootstrap starting.
I20260811 02:33:15.903235 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 2282
I20260811 02:33:15.903333 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:33:15.903522 17724 external_mini_cluster.cc:1428] Setting key 08ba233c3a290dda4bce3f6528b877be
I20260811 02:33:15.903859 2384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1: Neither blocks nor log segments found. Creating new log.
I20260811 02:33:15.904250 2384 log.cc:824] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1: Log is configured to *not* fsync() on all Append() calls
I20260811 02:33:15.904996 2384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1: No bootstrap required, opened a new log
I20260811 02:33:15.906028 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:15.904019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42510 (local address 127.17.79.62:33819)
0811 02:33:15.904295 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:15.904302 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:15.904326 (+ 24us) server_negotiation.cc:407] Connection header received
0811 02:33:15.904776 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:15.904782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:15.904816 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:15.904936 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:15.905601 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:15.905604 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:15.905604 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:15.905607 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:15.905650 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:15.905660 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:15.905789 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:15.905829 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 02:33:15.905889 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":166,"threads_started":1}
I20260811 02:33:15.906828 2384 raft_consensus.cc:348] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33819 } }
I20260811 02:33:15.906975 2384 raft_consensus.cc:374] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:33:15.907014 2384 raft_consensus.cc:729] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c33ace6a3d0f4326b0575eaf1880d8f1, State: Initialized, Role: FOLLOWER
I20260811 02:33:15.907135 2384 consensus_queue.cc:260] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33819 } }
I20260811 02:33:15.907213 2384 raft_consensus.cc:388] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:33:15.907236 2384 raft_consensus.cc:482] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:33:15.907282 2384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:33:15.908196 2384 raft_consensus.cc:504] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33819 } }
I20260811 02:33:15.908319 2384 leader_election.cc:302] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c33ace6a3d0f4326b0575eaf1880d8f1; no voters:
I20260811 02:33:15.908471 2384 leader_election.cc:288] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:33:15.908517 2391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:33:15.908674 2391 raft_consensus.cc:686] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [term 1 LEADER]: Becoming Leader. State: Replica: c33ace6a3d0f4326b0575eaf1880d8f1, State: Running, Role: LEADER
I20260811 02:33:15.908747 2384 sys_catalog.cc:564] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:33:15.908803 2391 consensus_queue.cc:237] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33819 } }
I20260811 02:33:15.909250 2392 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33819 } } }
I20260811 02:33:15.909274 2393 sys_catalog.cc:455] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c33ace6a3d0f4326b0575eaf1880d8f1. Latest consensus state: current_term: 1 leader_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c33ace6a3d0f4326b0575eaf1880d8f1" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33819 } } }
I20260811 02:33:15.909400 2392 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 02:33:15.909407 2393 sys_catalog.cc:458] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1 [sys.catalog]: This master's current role is: LEADER
I20260811 02:33:15.909653 2404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:33:15.910157 2404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:33:15.911634 2404 catalog_manager.cc:1347] Generated new cluster ID: 98df510166a04fdeba22b93508c20595
I20260811 02:33:15.911697 2404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:33:15.920557 2404 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:33:15.920749 2404 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:33:15.929061 2404 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c33ace6a3d0f4326b0575eaf1880d8f1: Generated new TSK 0
I20260811 02:33:15.929292 2404 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:33:15.931022 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33819
--builtin_ntp_servers=127.17.79.20:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 02:33:16.022523 2421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:16.022773 2421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:16.022809 2421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:16.024034 2421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:16.024099 2421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:16.024144 2421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:33:16.025557 2421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:16.025832 2421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:16.026147 2421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:16.032510 2431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:16.032511 2429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:16.032529 2434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:16.032774 2421 server_base.cc:1034] running on GCE node
I20260811 02:33:16.033092 2421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:16.033411 2421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:16.034616 2421 hybrid_clock.cc:648] HybridClock initialized: now 1786415596034600 us; error 32 us; skew 500 ppm
I20260811 02:33:16.036305 2421 webserver.cc:460] Webserver started at http://127.17.79.1:39301/ using document root <none> and password file <none>
I20260811 02:33:16.036584 2421 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:16.036655 2421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:16.036804 2421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:16.038102 2421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "1b4fb40dfd6348e08fa8916c6265d50a"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "b80d018ff08c7c62ba4b0f6795c44497"
server_key_iv: "70860a435eb74e5c26f1f2fa080eb692"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.038539 2421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "1b4fb40dfd6348e08fa8916c6265d50a"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "b80d018ff08c7c62ba4b0f6795c44497"
server_key_iv: "70860a435eb74e5c26f1f2fa080eb692"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.039906 2421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:16.040751 2445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.040956 2421 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:16.041045 2421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "1b4fb40dfd6348e08fa8916c6265d50a"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "b80d018ff08c7c62ba4b0f6795c44497"
server_key_iv: "70860a435eb74e5c26f1f2fa080eb692"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.041174 2421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:16.044631 2421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:16.044917 2421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:16.045073 2421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:16.045310 2421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:16.045660 2421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:16.045715 2421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.045749 2421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:16.045775 2421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.053437 2421 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:46545
I20260811 02:33:16.053483 2642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:46545 every 8 connection(s)
I20260811 02:33:16.053833 2421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:33:16.057704 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:16.054781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:36123 (local address 127.17.79.62:33819)
0811 02:33:16.054834 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:16.054836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:16.055058 (+ 222us) server_negotiation.cc:407] Connection header received
0811 02:33:16.055606 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:16.055607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:16.055614 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:16.055667 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:16.057156 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:16.057157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:16.057157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:16.057163 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:16.057183 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:16.057187 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:16.057253 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:16.057631 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 02:33:16.057645 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:33:16.057773 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 2421
I20260811 02:33:16.057999 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:33:16.058108 2648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:16.054746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33819 (local address 127.17.79.1:36123)
0811 02:33:16.054938 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:16.054973 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:16.055494 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:16.055734 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:16.055738 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:16.055747 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:16.056978 (+ 1231us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:33:16.056978 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:16.057006 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:33:16.057034 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:16.057252 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:16.057258 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:16.057262 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:33:16.057634 (+ 372us) client_negotiation.cc:240] Negotiation successful
0811 02:33:16.057759 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260811 02:33:16.058279 17724 external_mini_cluster.cc:1428] Setting key 92272ba5daa656489061254dbfee6ebd
I20260811 02:33:16.058665 2644 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33819
I20260811 02:33:16.058760 2644 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:16.058909 2644 heartbeater.cc:511] Master 127.17.79.62:33819 requested a full tablet report, sending...
I20260811 02:33:16.059304 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33819
--builtin_ntp_servers=127.17.79.20:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 02:33:16.059463 2323 ts_manager.cc:194] Registered new tserver with Master: 1b4fb40dfd6348e08fa8916c6265d50a (127.17.79.1:46545)
W20260811 02:33:16.148759 2653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:16.148985 2653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:16.149008 2653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:16.150127 2653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:16.150164 2653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:16.150190 2653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:33:16.151551 2653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:16.151754 2653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:16.152001 2653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:16.157346 2662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:16.157374 2663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:16.157437 2665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:16.158154 2653 server_base.cc:1034] running on GCE node
I20260811 02:33:16.158607 2653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:16.158912 2653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:16.160095 2653 hybrid_clock.cc:648] HybridClock initialized: now 1786415596160045 us; error 77 us; skew 500 ppm
I20260811 02:33:16.161917 2653 webserver.cc:460] Webserver started at http://127.17.79.2:36525/ using document root <none> and password file <none>
I20260811 02:33:16.162205 2653 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:16.162362 2653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:16.162492 2653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:16.163623 2653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "fe03c52be30d40ce980c489516faa88d"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "2b60a012d367bc3c4f7822ab62299290"
server_key_iv: "4218069b2931326d55e7f9a715c6a92a"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.163980 2653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "fe03c52be30d40ce980c489516faa88d"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "2b60a012d367bc3c4f7822ab62299290"
server_key_iv: "4218069b2931326d55e7f9a715c6a92a"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.165653 2653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:33:16.166766 2674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.166952 2653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:33:16.167073 2653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "fe03c52be30d40ce980c489516faa88d"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "2b60a012d367bc3c4f7822ab62299290"
server_key_iv: "4218069b2931326d55e7f9a715c6a92a"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.167155 2653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:16.170852 2653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:16.171293 2653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:16.171578 2653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:16.171934 2653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:16.172317 2653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:16.172375 2653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.172418 2653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:16.172459 2653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.179986 2653 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:35587
I20260811 02:33:16.180058 2869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:35587 every 8 connection(s)
I20260811 02:33:16.180418 2653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:33:16.184021 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:16.181269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:59477 (local address 127.17.79.62:33819)
0811 02:33:16.181491 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:16.181493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:16.181738 (+ 245us) server_negotiation.cc:407] Connection header received
0811 02:33:16.182455 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:16.182456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:16.182465 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:16.182527 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:16.183745 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:16.183746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:16.183747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:16.183752 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:16.183767 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:16.183771 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:16.183843 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:16.183931 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 02:33:16.183948 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192}
I20260811 02:33:16.184259 2874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:16.181235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33819 (local address 127.17.79.2:59477)
0811 02:33:16.181614 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:16.181651 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:16.182340 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:16.182605 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:16.182609 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:16.182617 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:16.183595 (+ 978us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:33:16.183596 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:16.183624 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:33:16.183652 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:16.183843 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:16.183850 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:16.183853 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:33:16.183943 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 02:33:16.184006 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":250,"threads_started":1}
I20260811 02:33:16.185065 2870 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33819
I20260811 02:33:16.185221 2870 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:16.185446 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 2653
I20260811 02:33:16.185559 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:33:16.185585 2870 heartbeater.cc:511] Master 127.17.79.62:33819 requested a full tablet report, sending...
I20260811 02:33:16.185772 17724 external_mini_cluster.cc:1428] Setting key 014a8a38f94d9616655208814803b8ba
I20260811 02:33:16.186057 2323 ts_manager.cc:194] Registered new tserver with Master: fe03c52be30d40ce980c489516faa88d (127.17.79.2:35587)
I20260811 02:33:16.187124 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33819
--builtin_ntp_servers=127.17.79.20:34293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 02:33:16.280304 2876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:16.280552 2876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:16.280606 2876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:16.281848 2876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:16.281912 2876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:16.281956 2876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:33:16.283392 2876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:34293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:16.283661 2876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:16.283951 2876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:16.289141 2882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:16.289177 2886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:16.289211 2890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:16.289481 2876 server_base.cc:1034] running on GCE node
I20260811 02:33:16.289702 2876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:16.289906 2876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:16.291051 2876 hybrid_clock.cc:648] HybridClock initialized: now 1786415596291003 us; error 79 us; skew 500 ppm
I20260811 02:33:16.292435 2876 webserver.cc:460] Webserver started at http://127.17.79.3:45439/ using document root <none> and password file <none>
I20260811 02:33:16.292649 2876 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:16.292692 2876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:16.292781 2876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:16.293932 2876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "f6cb6254c2b947f9a2ead9b8be5d382e"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "07ae27351adcd0b9143861c211e3e828"
server_key_iv: "03ee309dbd981d5cac68d8efb7424f7c"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.294525 2876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "f6cb6254c2b947f9a2ead9b8be5d382e"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "07ae27351adcd0b9143861c211e3e828"
server_key_iv: "03ee309dbd981d5cac68d8efb7424f7c"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.296069 2876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:33:16.296790 2897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.296962 2876 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:33:16.297039 2876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "f6cb6254c2b947f9a2ead9b8be5d382e"
format_stamp: "Formatted at 2026-08-11 02:33:16 on dist-test-slave-7nm7"
server_key: "07ae27351adcd0b9143861c211e3e828"
server_key_iv: "03ee309dbd981d5cac68d8efb7424f7c"
server_key_version: "encryptionkey@0"
I20260811 02:33:16.297093 2876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:16.300412 2876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:16.300638 2876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:16.300738 2876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:16.300897 2876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:16.301141 2876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:16.301173 2876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.301193 2876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:16.301205 2876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:16.307600 2876 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:44219
I20260811 02:33:16.307634 3098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:44219 every 8 connection(s)
I20260811 02:33:16.307961 2876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:33:16.311297 2388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:16.308787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:44727 (local address 127.17.79.62:33819)
0811 02:33:16.308838 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:16.308840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:16.309042 (+ 202us) server_negotiation.cc:407] Connection header received
0811 02:33:16.309681 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:16.309683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:16.309691 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:16.309779 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:16.311087 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:16.311089 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:16.311089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:33:16.311093 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:16.311114 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:33:16.311118 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:16.311173 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:16.311225 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 02:33:16.311237 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:33:16.311465 3101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:16.308741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33819 (local address 127.17.79.3:44727)
0811 02:33:16.308923 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:16.308966 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:16.309435 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:16.309843 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:16.309847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:16.309854 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:16.310952 (+ 1098us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:33:16.310952 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:16.310980 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:33:16.311006 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:16.311173 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:16.311176 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:16.311178 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:33:16.311225 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 02:33:16.311270 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260811 02:33:16.311968 3099 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33819
I20260811 02:33:16.312052 3099 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:16.312179 3099 heartbeater.cc:511] Master 127.17.79.62:33819 requested a full tablet report, sending...
I20260811 02:33:16.312525 2322 ts_manager.cc:194] Registered new tserver with Master: f6cb6254c2b947f9a2ead9b8be5d382e (127.17.79.3:44219)
I20260811 02:33:16.313337 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 2876
I20260811 02:33:16.313408 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:33:16.313570 17724 external_mini_cluster.cc:1428] Setting key 2d840d1f30f6fa933e124be83bc9c202
I20260811 02:33:16.314339 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 02:33:16.316017 2388 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:33:16.315662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42516 (local address 127.17.79.62:33819)
0811 02:33:16.315705 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:16.315707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:16.315783 (+ 76us) server_negotiation.cc:407] Connection header received
0811 02:33:16.315835 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:16.315836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:16.315840 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:16.315885 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:16.315975 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42516: BlockingRecv error: recv got EOF from 127.0.0.1:42516 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:33:16.316138 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 2421
I20260811 02:33:16.341558 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 2653
I20260811 02:33:16.354493 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 2876
I20260811 02:33:16.362972 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 2282
2026-08-11T02:33:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (610 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:33:16 dist-test-slave-7nm7 krb5kdc[3117](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:33:16 dist-test-slave-7nm7 krb5kdc[3117](info): set up 2 sockets
Aug 11 02:33:16 dist-test-slave-7nm7 krb5kdc[3117](info): commencing operation
krb5kdc: starting...
W20260811 02:33:17.685737 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.295s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:33:17 dist-test-slave-7nm7 krb5kdc[3117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:33:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:33:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:33:17.810561 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39393
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:39393
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:33:17.902550 3142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:17.902838 3142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:17.902878 3142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:17.904011 3142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:33:17.904075 3142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:17.904100 3142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:17.904129 3142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:33:17.904157 3142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:33:17.905638 3142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:39393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:17.905908 3142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:17.906141 3142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:17.911046 3150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:17.911041 3157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:17.911056 3151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:17.911352 3142 server_base.cc:1034] running on GCE node
I20260811 02:33:17.911602 3142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:17.911913 3142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:17.913079 3142 hybrid_clock.cc:648] HybridClock initialized: now 1786415597913063 us; error 35 us; skew 500 ppm
Aug 11 02:33:17 dist-test-slave-7nm7 krb5kdc[3117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415597, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:33:17.915573 3142 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:33:17.916023 3142 webserver.cc:460] Webserver started at http://127.17.79.62:37729/ using document root <none> and password file <none>
I20260811 02:33:17.916204 3142 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:17.916253 3142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:17.916348 3142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:17.917354 3142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "af4a8a74e8884eb69373400fe26f7f11"
format_stamp: "Formatted at 2026-08-11 02:33:17 on dist-test-slave-7nm7"
server_key: "113aedfe47b0fed73a30249e466bbfd5"
server_key_iv: "9533abd4ec84eb5028a7181132aadaa8"
server_key_version: "encryptionkey@0"
I20260811 02:33:17.917651 3142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "af4a8a74e8884eb69373400fe26f7f11"
format_stamp: "Formatted at 2026-08-11 02:33:17 on dist-test-slave-7nm7"
server_key: "113aedfe47b0fed73a30249e466bbfd5"
server_key_iv: "9533abd4ec84eb5028a7181132aadaa8"
server_key_version: "encryptionkey@0"
I20260811 02:33:17.918998 3142 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:33:17.919708 3170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:17.919883 3142 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:33:17.919970 3142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "af4a8a74e8884eb69373400fe26f7f11"
format_stamp: "Formatted at 2026-08-11 02:33:17 on dist-test-slave-7nm7"
server_key: "113aedfe47b0fed73a30249e466bbfd5"
server_key_iv: "9533abd4ec84eb5028a7181132aadaa8"
server_key_version: "encryptionkey@0"
I20260811 02:33:17.920037 3142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:17.935022 3142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:17.937325 3142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:17.937481 3142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:17.941519 3142 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:39393
I20260811 02:33:17.941629 3259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:39393 every 8 connection(s)
I20260811 02:33:17.941934 3142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:33:17.942977 3261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:33:17.945199 3261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11: Bootstrap starting.
I20260811 02:33:17.945739 3261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11: Neither blocks nor log segments found. Creating new log.
I20260811 02:33:17.945967 3261 log.cc:824] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11: Log is configured to *not* fsync() on all Append() calls
I20260811 02:33:17.946673 3261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11: No bootstrap required, opened a new log
I20260811 02:33:17.946674 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 3142
I20260811 02:33:17.946777 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:33:17.946955 17724 external_mini_cluster.cc:1428] Setting key 3b10c7d46d9ad4fd101a0eb46c4195ff
I20260811 02:33:17.948848 3261 raft_consensus.cc:348] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4a8a74e8884eb69373400fe26f7f11" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39393 } }
I20260811 02:33:17.949030 3261 raft_consensus.cc:374] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:33:17.949072 3261 raft_consensus.cc:729] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4a8a74e8884eb69373400fe26f7f11, State: Initialized, Role: FOLLOWER
I20260811 02:33:17.949249 3261 consensus_queue.cc:260] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4a8a74e8884eb69373400fe26f7f11" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39393 } }
I20260811 02:33:17.949332 3261 raft_consensus.cc:388] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:33:17.949355 3261 raft_consensus.cc:482] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:33:17.949419 3261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:33:17.950497 3261 raft_consensus.cc:504] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4a8a74e8884eb69373400fe26f7f11" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39393 } }
I20260811 02:33:17.950603 3261 leader_election.cc:302] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af4a8a74e8884eb69373400fe26f7f11; no voters:
I20260811 02:33:17.950765 3261 leader_election.cc:288] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:33:17.950794 3269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:33:17.950953 3269 raft_consensus.cc:686] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [term 1 LEADER]: Becoming Leader. State: Replica: af4a8a74e8884eb69373400fe26f7f11, State: Running, Role: LEADER
I20260811 02:33:17.950985 3261 sys_catalog.cc:564] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:33:17.951046 3269 consensus_queue.cc:237] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4a8a74e8884eb69373400fe26f7f11" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39393 } }
I20260811 02:33:17.951346 3269 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af4a8a74e8884eb69373400fe26f7f11. Latest consensus state: current_term: 1 leader_uuid: "af4a8a74e8884eb69373400fe26f7f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4a8a74e8884eb69373400fe26f7f11" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39393 } } }
I20260811 02:33:17.951422 3269 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [sys.catalog]: This master's current role is: LEADER
I20260811 02:33:17.951622 3281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:33:17.952121 3281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:33:17.952569 3273 sys_catalog.cc:455] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af4a8a74e8884eb69373400fe26f7f11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af4a8a74e8884eb69373400fe26f7f11" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39393 } } }
I20260811 02:33:17.952653 3273 sys_catalog.cc:458] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11 [sys.catalog]: This master's current role is: LEADER
I20260811 02:33:17.954052 3281 catalog_manager.cc:1347] Generated new cluster ID: 84248d690582457f885e8d343d098509
I20260811 02:33:17.954128 3281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:33:17 dist-test-slave-7nm7 krb5kdc[3117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:33:17.959467 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:17.947470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48240 (local address 127.17.79.62:39393)
0811 02:33:17.947708 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:17.947718 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:17.947751 (+ 33us) server_negotiation.cc:407] Connection header received
0811 02:33:17.948811 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:17.948820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:17.948884 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:17.949033 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:17.949795 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:17.951222 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:17.952233 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:17.952877 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:17.952992 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:17.955836 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:17.955841 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:17.955841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:33:17.955852 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:17.957790 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:17.958176 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:17.958179 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:17.958179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:17.958361 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:17.958566 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:17.958567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:17.958567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:17.958871 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:17.959036 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:17.959117 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 02:33:17.959268 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":116,"threads_started":1}
I20260811 02:33:17.966213 3281 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:33:17.966773 3281 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:33:17.970432 3281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11: Generated new TSK 0
I20260811 02:33:17.970611 3281 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:33:17.998500 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39393
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:33:18.089359 3303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:18.089576 3303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:18.089609 3303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:18.090772 3303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:18.090811 3303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:18.090837 3303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:33:18.094259 3303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:18.094488 3303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:18.094682 3303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:18.100054 3314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:18.100163 3303 server_base.cc:1034] running on GCE node
W20260811 02:33:18.100036 3313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:18.100024 3317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:18.100487 3303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:18.100767 3303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:18.101935 3303 hybrid_clock.cc:648] HybridClock initialized: now 1786415598101910 us; error 37 us; skew 500 ppm
Aug 11 02:33:18 dist-test-slave-7nm7 krb5kdc[3117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415598, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:33:18.104609 3303 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:33:18.105014 3303 webserver.cc:460] Webserver started at http://127.17.79.1:36953/ using document root <none> and password file <none>
I20260811 02:33:18.105230 3303 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:18.105281 3303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:18.105369 3303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:18.106426 3303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "07100284419e4c11a0ef06c3ed71be1e"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "1efb9ac503efcf14b25e9198b4331695"
server_key_iv: "e878d5a6946969ecc67669e8adbdc154"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.106731 3303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "07100284419e4c11a0ef06c3ed71be1e"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "1efb9ac503efcf14b25e9198b4331695"
server_key_iv: "e878d5a6946969ecc67669e8adbdc154"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.107985 3303 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:18.108691 3330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.108875 3303 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:33:18.108952 3303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "07100284419e4c11a0ef06c3ed71be1e"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "1efb9ac503efcf14b25e9198b4331695"
server_key_iv: "e878d5a6946969ecc67669e8adbdc154"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.109011 3303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:18.117844 3303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:18.119869 3303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:18.119983 3303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:18.120167 3303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:18.120428 3303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:18.120458 3303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.120479 3303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:18.120492 3303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.126626 3303 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:33395
I20260811 02:33:18.126853 3536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:33395 every 8 connection(s)
I20260811 02:33:18.127023 3303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:33:18 dist-test-slave-7nm7 krb5kdc[3117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415598, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:33:18.134816 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 3303
I20260811 02:33:18.134899 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:33:18.135119 17724 external_mini_cluster.cc:1428] Setting key 34d1b0ef29c5e53e9874bbb29e193cbf
I20260811 02:33:18.136951 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.127758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:54287 (local address 127.17.79.62:39393)
0811 02:33:18.127817 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.127820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.128020 (+ 200us) server_negotiation.cc:407] Connection header received
0811 02:33:18.128486 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.128488 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.128498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.128546 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:18.129439 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.129937 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.130946 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.131241 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.131311 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.133508 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:18.133509 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:18.133509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:33:18.133518 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:18.135412 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.135906 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.135907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.135907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.135964 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.136274 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.136275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.136276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.136394 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:18.136462 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.136752 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.136859 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:33:18.137108 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.127747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39393 (local address 127.17.79.1:54287)
0811 02:33:18.127903 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.127939 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.128406 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.128611 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.128614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.129173 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:18.129360 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.129365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.130016 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.130017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.130859 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.130861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.131357 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.131358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.131470 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.132008 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:18.132016 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:18.133424 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:18.135501 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:33:18.135510 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:33:18.135512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:33:18.135798 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:33:18.136059 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:33:18.136060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:33:18.136061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:33:18.136197 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:33:18.136466 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:18.136473 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:18.136615 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.136716 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.136878 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260811 02:33:18.137737 3538 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39393
I20260811 02:33:18.137854 3538 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:18.138054 3538 heartbeater.cc:511] Master 127.17.79.62:39393 requested a full tablet report, sending...
I20260811 02:33:18.138659 3200 ts_manager.cc:194] Registered new tserver with Master: 07100284419e4c11a0ef06c3ed71be1e (127.17.79.1:33395)
I20260811 02:33:18.139612 3200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:54287
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:33:18.159204 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39393
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:33:18.242064 3551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:18.242319 3551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:18.242347 3551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:18.243458 3551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:18.243496 3551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:18.243522 3551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:33:18.245065 3551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:18.245272 3551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:18.245474 3551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:18.250521 3563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:18.250592 3558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:18.250530 3559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:18.251037 3551 server_base.cc:1034] running on GCE node
I20260811 02:33:18.251295 3551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:18.251581 3551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:18.252739 3551 hybrid_clock.cc:648] HybridClock initialized: now 1786415598252720 us; error 37 us; skew 500 ppm
Aug 11 02:33:18 dist-test-slave-7nm7 krb5kdc[3117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415598, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:33:18.255350 3551 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:33:18.255745 3551 webserver.cc:460] Webserver started at http://127.17.79.2:34797/ using document root <none> and password file <none>
I20260811 02:33:18.256004 3551 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:18.256072 3551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:18.256215 3551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:18.257261 3551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "ddde21166ecd410c832900ce4f467498"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "08f2924c954607c8180c1b7dc92aa062"
server_key_iv: "c03c3419f1ba1d1d9a80b93cbe172503"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.257612 3551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "ddde21166ecd410c832900ce4f467498"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "08f2924c954607c8180c1b7dc92aa062"
server_key_iv: "c03c3419f1ba1d1d9a80b93cbe172503"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.259032 3551 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:33:18.259850 3581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.260032 3551 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:33:18.260140 3551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "ddde21166ecd410c832900ce4f467498"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "08f2924c954607c8180c1b7dc92aa062"
server_key_iv: "c03c3419f1ba1d1d9a80b93cbe172503"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.260211 3551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:18.268132 3551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:18.270372 3551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:18.270529 3551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:18.270746 3551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:18.271039 3551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:18.271090 3551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.271130 3551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:18.271157 3551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.277076 3551 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:44781
I20260811 02:33:18.277120 3798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:44781 every 8 connection(s)
I20260811 02:33:18.277434 3551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
Aug 11 02:33:18 dist-test-slave-7nm7 krb5kdc[3117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415598, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:33:18.284448 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 3551
I20260811 02:33:18.284578 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:33:18.284812 17724 external_mini_cluster.cc:1428] Setting key 22d8b866bf6c2de232263157e3008a48
I20260811 02:33:18.287528 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.278177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:54881 (local address 127.17.79.62:39393)
0811 02:33:18.278249 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.278252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.278483 (+ 231us) server_negotiation.cc:407] Connection header received
0811 02:33:18.279002 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.279003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.279014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.279087 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:18.280037 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.280565 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.281579 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.281784 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.281867 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.284063 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:18.284064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:18.284064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:33:18.284070 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:18.285724 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.286305 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.286307 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.286308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.286404 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.286773 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.286774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.286774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.286897 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:18.286952 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.287375 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.287462 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:33:18.287935 3802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.278138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39393 (local address 127.17.79.2:54881)
0811 02:33:18.278345 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.278397 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.278885 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.279167 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.279170 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.279743 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:18.279938 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.279943 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.280654 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.280655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.281471 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.281473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.281873 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.281874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.281971 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.282560 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:18.282568 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:18.283976 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:18.285823 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:33:18.285831 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:33:18.285834 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:33:18.286165 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:33:18.286507 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:33:18.286508 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:33:18.286508 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:33:18.286671 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:33:18.286961 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:18.286968 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:18.287163 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.287439 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.287652 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":119,"threads_started":1}
I20260811 02:33:18.288443 3800 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39393
I20260811 02:33:18.288554 3800 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:18.288749 3800 heartbeater.cc:511] Master 127.17.79.62:39393 requested a full tablet report, sending...
I20260811 02:33:18.289206 3200 ts_manager.cc:194] Registered new tserver with Master: ddde21166ecd410c832900ce4f467498 (127.17.79.2:44781)
I20260811 02:33:18.289825 3200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:54881
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:33:18.311209 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39393
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:36525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:33:18.394055 3810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:33:18.394286 3810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:33:18.394313 3810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:33:18.395385 3810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:33:18.395421 3810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:33:18.395449 3810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:33:18.396847 3810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:36525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:33:18.397053 3810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:33:18.397238 3810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:33:18.402451 3821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:18.402451 3823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:33:18.402477 3819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:33:18.402746 3810 server_base.cc:1034] running on GCE node
I20260811 02:33:18.402966 3810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:33:18.403220 3810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:33:18.404379 3810 hybrid_clock.cc:648] HybridClock initialized: now 1786415598404358 us; error 37 us; skew 500 ppm
Aug 11 02:33:18 dist-test-slave-7nm7 krb5kdc[3117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415598, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:33:18.407052 3810 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:33:18.407644 3810 webserver.cc:460] Webserver started at http://127.17.79.3:40763/ using document root <none> and password file <none>
I20260811 02:33:18.407931 3810 fs_manager.cc:359] Metadata directory not provided
I20260811 02:33:18.408005 3810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:33:18.408152 3810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:33:18.409202 3810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "15842bb5a039bd500c3a3044ca21954b"
server_key_iv: "65677d7dd2ac05b6f7ad720592b54903"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.409559 3810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "15842bb5a039bd500c3a3044ca21954b"
server_key_iv: "65677d7dd2ac05b6f7ad720592b54903"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.410965 3810 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:33:18.411773 3836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.411988 3810 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:33:18.412075 3810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0"
format_stamp: "Formatted at 2026-08-11 02:33:18 on dist-test-slave-7nm7"
server_key: "15842bb5a039bd500c3a3044ca21954b"
server_key_iv: "65677d7dd2ac05b6f7ad720592b54903"
server_key_version: "encryptionkey@0"
I20260811 02:33:18.412143 3810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:33:18.439105 3810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:33:18.441447 3810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:33:18.441627 3810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:33:18.441879 3810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:33:18.442194 3810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:33:18.442265 3810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.442324 3810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:33:18.442353 3810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:33:18.448869 3810 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39917
I20260811 02:33:18.448935 4041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39917 every 8 connection(s)
I20260811 02:33:18.449254 3810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
Aug 11 02:33:18 dist-test-slave-7nm7 krb5kdc[3117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415598, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:33:18.457522 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 3810
I20260811 02:33:18.457653 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:33:18.457850 17724 external_mini_cluster.cc:1428] Setting key 3fae019f8a13977a26101a6ee00bbf61
I20260811 02:33:18.459578 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.450012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:59897 (local address 127.17.79.62:39393)
0811 02:33:18.450112 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.450114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.450306 (+ 192us) server_negotiation.cc:407] Connection header received
0811 02:33:18.450903 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.450904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.450923 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.450987 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:18.452167 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.452870 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.453870 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.454052 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.454119 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.456275 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:18.456276 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:18.456277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:33:18.456284 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:18.458154 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.458595 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.458597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.458597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.458658 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.458919 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.458921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.458921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.459044 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:18.459119 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.459404 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.459488 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 02:33:18.459786 4046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.449974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39393 (local address 127.17.79.3:59897)
0811 02:33:18.450159 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.450196 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.450769 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.451044 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.451047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.451838 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:33:18.452040 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.452045 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.452962 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.452964 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.453786 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.453789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.454134 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.454135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.454286 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.454783 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:33:18.454791 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:33:18.456184 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:33:18.458262 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:33:18.458270 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:33:18.458272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:33:18.458501 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:33:18.458732 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:33:18.458733 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:33:18.458733 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:33:18.458846 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:33:18.459109 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:33:18.459117 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:33:18.459266 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.459366 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.459532 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":112,"threads_started":1}
I20260811 02:33:18.460273 4042 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39393
I20260811 02:33:18.460387 4042 heartbeater.cc:464] Registering TS with master...
I20260811 02:33:18.460573 4042 heartbeater.cc:511] Master 127.17.79.62:39393 requested a full tablet report, sending...
I20260811 02:33:18.460949 3200 ts_manager.cc:194] Registered new tserver with Master: 0bb9b6e27d8545f8a6a6937c299fd1c0 (127.17.79.3:39917)
I20260811 02:33:18.461294 3200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:59897
I20260811 02:33:18.469730 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:33:18.477754 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.471319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48242 (local address 127.17.79.62:39393)
0811 02:33:18.471378 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.471380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.471439 (+ 59us) server_negotiation.cc:407] Connection header received
0811 02:33:18.471483 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.471484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.471493 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.471557 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:33:18.472131 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.472648 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.473390 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.473576 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.473640 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.475103 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:33:18.475104 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:33:18.475105 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:33:18.475111 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:33:18.476431 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.476862 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.476865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.476914 (+ 49us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.476976 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:33:18.477206 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:33:18.477208 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:33:18.477208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:33:18.477376 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:33:18.477467 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.477619 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.477685 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 02:33:18.479532 3200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48242:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:33:18.481196 3200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:33:18.488754 4062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.484135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39917 (local address 127.0.0.1:40828)
0811 02:33:18.484592 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.484607 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.484689 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.485336 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.485337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.485339 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:33:18.485399 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.485401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.486373 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.486374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.487477 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.487480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.488435 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.488436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.488513 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.488526 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.488603 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.488662 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":29,"thread_start_us":106,"threads_started":1}
I20260811 02:33:18.488772 4069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.484642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40828 (local address 127.17.79.3:39917)
0811 02:33:18.484999 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.485005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.485022 (+ 17us) server_negotiation.cc:407] Connection header received
0811 02:33:18.485081 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.485083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.485105 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.485484 (+ 379us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:33:18.485565 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.486212 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.487570 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.488334 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.488425 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.488486 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.488630 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.488685 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":252,"threads_started":1}
I20260811 02:33:18.488849 4066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.484247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56630 (local address 127.17.79.1:33395)
0811 02:33:18.484438 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.484444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.484690 (+ 246us) server_negotiation.cc:407] Connection header received
0811 02:33:18.484736 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.484739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.484768 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.484847 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:33:18.485050 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.486197 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.487695 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.488366 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.488427 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.488486 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.488716 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.488758 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":116,"threads_started":1}
I20260811 02:33:18.488879 4065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.484135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:44781 (local address 127.0.0.1:34740)
0811 02:33:18.485105 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.485118 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.485202 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.485504 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.485505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.485508 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:33:18.485548 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.485549 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.486770 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.486771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.487822 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.487824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.488563 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.488564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.488622 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.488626 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.488671 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.488700 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":942,"mutex_wait_us":3,"thread_start_us":90,"threads_started":1}
I20260811 02:33:18.489275 4061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.484135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33395 (local address 127.0.0.1:56630)
0811 02:33:18.484461 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.484507 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.484596 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.484868 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.484871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.484875 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:33:18.484946 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.484949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.486324 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.486325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.487611 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.487614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.488523 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.488524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.488616 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.488621 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.489158 (+ 537us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.489206 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":52,"thread_start_us":51,"threads_started":1}
I20260811 02:33:18.489275 4067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.484596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34740 (local address 127.17.79.2:44781)
0811 02:33:18.484994 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.484999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.485286 (+ 287us) server_negotiation.cc:407] Connection header received
0811 02:33:18.485332 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.485334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.485350 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.485429 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:33:18.485631 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.486669 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.487901 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.488379 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.488470 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.488529 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.488797 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.489192 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":96,"threads_started":1}
I20260811 02:33:18.489634 3923 tablet_service.cc:1467] Processing CreateTablet for tablet cb3c558f30d148ce848a0e8db9b31b8e (DEFAULT_TABLE table=test-table [id=d4e0e9b145d14f548d6857f88dd512e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:33:18.489836 3675 tablet_service.cc:1467] Processing CreateTablet for tablet cb3c558f30d148ce848a0e8db9b31b8e (DEFAULT_TABLE table=test-table [id=d4e0e9b145d14f548d6857f88dd512e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:33:18.490029 3923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3c558f30d148ce848a0e8db9b31b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:33:18.490137 3675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3c558f30d148ce848a0e8db9b31b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:33:18.490199 3423 tablet_service.cc:1467] Processing CreateTablet for tablet cb3c558f30d148ce848a0e8db9b31b8e (DEFAULT_TABLE table=test-table [id=d4e0e9b145d14f548d6857f88dd512e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:33:18.490600 3423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb3c558f30d148ce848a0e8db9b31b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:33:18.493877 4074 tablet_bootstrap.cc:492] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Bootstrap starting.
I20260811 02:33:18.494050 4075 tablet_bootstrap.cc:492] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: Bootstrap starting.
I20260811 02:33:18.494417 4070 tablet_bootstrap.cc:492] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Bootstrap starting.
I20260811 02:33:18.494724 4075 tablet_bootstrap.cc:654] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: Neither blocks nor log segments found. Creating new log.
I20260811 02:33:18.494822 4074 tablet_bootstrap.cc:654] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Neither blocks nor log segments found. Creating new log.
I20260811 02:33:18.495059 4070 tablet_bootstrap.cc:654] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Neither blocks nor log segments found. Creating new log.
I20260811 02:33:18.495314 4075 log.cc:824] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: Log is configured to *not* fsync() on all Append() calls
I20260811 02:33:18.495605 4074 log.cc:824] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Log is configured to *not* fsync() on all Append() calls
I20260811 02:33:18.495855 4070 log.cc:824] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Log is configured to *not* fsync() on all Append() calls
I20260811 02:33:18.496351 4075 tablet_bootstrap.cc:492] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: No bootstrap required, opened a new log
I20260811 02:33:18.496479 4075 ts_tablet_manager.cc:1397] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:33:18.496515 4074 tablet_bootstrap.cc:492] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: No bootstrap required, opened a new log
I20260811 02:33:18.496575 4074 ts_tablet_manager.cc:1397] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:33:18.496637 4070 tablet_bootstrap.cc:492] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: No bootstrap required, opened a new log
I20260811 02:33:18.496709 4070 ts_tablet_manager.cc:1397] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:33:18.498544 4075 raft_consensus.cc:348] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.498545 4074 raft_consensus.cc:348] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.498718 4075 raft_consensus.cc:374] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:33:18.498718 4074 raft_consensus.cc:374] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:33:18.498756 4075 raft_consensus.cc:729] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07100284419e4c11a0ef06c3ed71be1e, State: Initialized, Role: FOLLOWER
I20260811 02:33:18.498756 4074 raft_consensus.cc:729] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddde21166ecd410c832900ce4f467498, State: Initialized, Role: FOLLOWER
I20260811 02:33:18.498880 4074 consensus_queue.cc:260] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.498914 4075 consensus_queue.cc:260] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.499091 4070 raft_consensus.cc:348] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.499269 4070 raft_consensus.cc:374] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:33:18.499320 4070 raft_consensus.cc:729] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bb9b6e27d8545f8a6a6937c299fd1c0, State: Initialized, Role: FOLLOWER
I20260811 02:33:18.499421 4074 ts_tablet_manager.cc:1428] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:33:18.499419 4075 ts_tablet_manager.cc:1428] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 02:33:18.499455 3538 heartbeater.cc:503] Master 127.17.79.62:39393 was elected leader, sending a full tablet report...
I20260811 02:33:18.499456 4070 consensus_queue.cc:260] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.499745 4070 ts_tablet_manager.cc:1428] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:33:18.499768 4042 heartbeater.cc:503] Master 127.17.79.62:39393 was elected leader, sending a full tablet report...
I20260811 02:33:18.499912 3800 heartbeater.cc:503] Master 127.17.79.62:39393 was elected leader, sending a full tablet report...
W20260811 02:33:18.528206 3801 tablet.cc:2369] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:33:18.627795 3540 tablet.cc:2369] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:33:18.699888 4045 tablet.cc:2369] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:33:18.835883 4081 raft_consensus.cc:482] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:33:18.836038 4081 raft_consensus.cc:504] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.836421 4081 leader_election.cc:288] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bb9b6e27d8545f8a6a6937c299fd1c0 (127.17.79.3:39917), 07100284419e4c11a0ef06c3ed71be1e (127.17.79.1:33395)
I20260811 02:33:18.839828 4069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.836796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:53871 (local address 127.17.79.3:39917)
0811 02:33:18.836857 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.836859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.836872 (+ 13us) server_negotiation.cc:407] Connection header received
0811 02:33:18.836977 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.836978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.836992 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.837055 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:33:18.837248 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.837951 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.839028 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.839436 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.839494 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.839503 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.839700 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.839749 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 02:33:18.839865 4066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.836731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:58441 (local address 127.17.79.1:33395)
0811 02:33:18.836791 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.836793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.836928 (+ 135us) server_negotiation.cc:407] Connection header received
0811 02:33:18.837009 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.837010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.837022 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.837097 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:33:18.837295 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.838078 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.839094 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.839503 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.839590 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.839603 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.839756 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.839802 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 02:33:18.839865 4083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.836646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39917 (local address 127.17.79.2:53871)
0811 02:33:18.836812 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.836825 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.836886 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.837070 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.837071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.837074 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:33:18.837157 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.837165 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.838035 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.838036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.838934 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.838937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.839534 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.839535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.839613 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.839619 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.839683 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.839746 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":88,"threads_started":1}
I20260811 02:33:18.839870 4084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.836650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33395 (local address 127.17.79.2:58441)
0811 02:33:18.836834 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.836847 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:33:18.836947 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:33:18.837122 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:33:18.837123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:33:18.837125 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:33:18.837210 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.837213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.838171 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.838173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.838973 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:33:18.838990 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.839596 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.839598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:33:18.839668 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.839673 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:33:18.839733 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 02:33:18.839771 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":80,"threads_started":1}
I20260811 02:33:18.840323 3955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3c558f30d148ce848a0e8db9b31b8e" candidate_uuid: "ddde21166ecd410c832900ce4f467498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" is_pre_election: true
I20260811 02:33:18.840363 3460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3c558f30d148ce848a0e8db9b31b8e" candidate_uuid: "ddde21166ecd410c832900ce4f467498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07100284419e4c11a0ef06c3ed71be1e" is_pre_election: true
I20260811 02:33:18.840526 3460 raft_consensus.cc:2454] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddde21166ecd410c832900ce4f467498 in term 0.
I20260811 02:33:18.840526 3955 raft_consensus.cc:2454] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddde21166ecd410c832900ce4f467498 in term 0.
I20260811 02:33:18.840783 3583 leader_election.cc:302] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07100284419e4c11a0ef06c3ed71be1e, ddde21166ecd410c832900ce4f467498; no voters:
I20260811 02:33:18.840957 4081 raft_consensus.cc:2781] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:33:18.841027 4081 raft_consensus.cc:482] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:33:18.841045 4081 raft_consensus.cc:3037] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:33:18.841873 4081 raft_consensus.cc:504] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.842043 4081 leader_election.cc:288] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [CANDIDATE]: Term 1 election: Requested vote from peers 0bb9b6e27d8545f8a6a6937c299fd1c0 (127.17.79.3:39917), 07100284419e4c11a0ef06c3ed71be1e (127.17.79.1:33395)
I20260811 02:33:18.842253 3955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3c558f30d148ce848a0e8db9b31b8e" candidate_uuid: "ddde21166ecd410c832900ce4f467498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0"
I20260811 02:33:18.842306 3460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb3c558f30d148ce848a0e8db9b31b8e" candidate_uuid: "ddde21166ecd410c832900ce4f467498" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07100284419e4c11a0ef06c3ed71be1e"
I20260811 02:33:18.842344 3955 raft_consensus.cc:3037] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:33:18.842393 3460 raft_consensus.cc:3037] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:33:18.843066 3955 raft_consensus.cc:2454] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddde21166ecd410c832900ce4f467498 in term 1.
I20260811 02:33:18.843200 3460 raft_consensus.cc:2454] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddde21166ecd410c832900ce4f467498 in term 1.
I20260811 02:33:18.843261 3584 leader_election.cc:302] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bb9b6e27d8545f8a6a6937c299fd1c0, ddde21166ecd410c832900ce4f467498; no voters:
I20260811 02:33:18.843366 4081 raft_consensus.cc:2781] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:33:18.843554 4081 raft_consensus.cc:686] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 1 LEADER]: Becoming Leader. State: Replica: ddde21166ecd410c832900ce4f467498, State: Running, Role: LEADER
I20260811 02:33:18.843644 4081 consensus_queue.cc:237] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } }
I20260811 02:33:18.844602 3193 catalog_manager.cc:5495] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddde21166ecd410c832900ce4f467498 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "ddde21166ecd410c832900ce4f467498" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddde21166ecd410c832900ce4f467498" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44781 } health_report { overall_health: HEALTHY } } }
I20260811 02:33:18.929553 4067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.927303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34754 (local address 127.17.79.2:44781)
0811 02:33:18.927378 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 02:33:18.927380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:33:18.927390 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:33:18.927424 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:33:18.927425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:33:18.927450 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:33:18.927523 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:33:18.927640 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.928122 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.928871 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:33:18.929090 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:33:18.929157 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:33:18.929289 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:33:18.929386 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:33:18.929444 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 02:33:18.929475 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 02:33:18.929493 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 02:33:18.931939 3955 raft_consensus.cc:1261] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 1 FOLLOWER]: Refusing update from remote peer ddde21166ecd410c832900ce4f467498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:33:18.931936 3460 raft_consensus.cc:1261] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 1 FOLLOWER]: Refusing update from remote peer ddde21166ecd410c832900ce4f467498: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:33:18.932333 4085 consensus_queue.cc:1035] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bb9b6e27d8545f8a6a6937c299fd1c0" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:33:18.932564 4081 consensus_queue.cc:1035] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07100284419e4c11a0ef06c3ed71be1e" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:33:18.935068 4089 mvcc.cc:205] Tried to move back new op lower bound from 7317158293220941824 to 7317158292864151552. Current Snapshot: MvccSnapshot[applied={T|T < 7317158293220941824}]
I20260811 02:33:18.935325 4093 mvcc.cc:205] Tried to move back new op lower bound from 7317158293220941824 to 7317158292864151552. Current Snapshot: MvccSnapshot[applied={T|T < 7317158293220941824}]
I20260811 02:33:18.937791 3193 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:33:18.937896 3193 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48242:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:33:18.939267 3193 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af4a8a74e8884eb69373400fe26f7f11: Sending DeleteTablet for 3 replicas of tablet cb3c558f30d148ce848a0e8db9b31b8e
I20260811 02:33:18.939616 3923 tablet_service.cc:1514] Processing DeleteTablet for tablet cb3c558f30d148ce848a0e8db9b31b8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:33:18 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:40828
I20260811 02:33:18.939690 3423 tablet_service.cc:1514] Processing DeleteTablet for tablet cb3c558f30d148ce848a0e8db9b31b8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:33:18 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:56630
I20260811 02:33:18.939960 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 3303
I20260811 02:33:18.939947 3675 tablet_service.cc:1514] Processing DeleteTablet for tablet cb3c558f30d148ce848a0e8db9b31b8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:33:18 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:34740
I20260811 02:33:18.940171 4109 tablet_replica.cc:330] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e: stopping tablet replica
I20260811 02:33:18.940344 4109 raft_consensus.cc:2229] T cb3c558f30d148ce848a0e8db9b31b8e P 07100284419e4c11a0ef06c3ed71be1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:33:18.948127 4108 tablet_replica.cc:330] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: stopping tablet replica
I20260811 02:33:18.948321 4108 raft_consensus.cc:2229] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:33:18.948472 4108 raft_consensus.cc:2258] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:33:18.948680 4110 tablet_replica.cc:330] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: stopping tablet replica
I20260811 02:33:18.948784 4110 raft_consensus.cc:2229] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:33:18.948892 4110 raft_consensus.cc:2258] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:33:18.949208 4108 ts_tablet_manager.cc:1905] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:33:18.951086 4108 ts_tablet_manager.cc:1918] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:33:18.951236 4108 log.cc:1196] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/cb3c558f30d148ce848a0e8db9b31b8e
I20260811 02:33:18.951225 4110 ts_tablet_manager.cc:1905] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:33:18.951679 4108 ts_tablet_manager.cc:1939] T cb3c558f30d148ce848a0e8db9b31b8e P 0bb9b6e27d8545f8a6a6937c299fd1c0: Deleting consensus metadata
I20260811 02:33:18.952374 3173 catalog_manager.cc:4841] TS 0bb9b6e27d8545f8a6a6937c299fd1c0 (127.17.79.3:39917): tablet cb3c558f30d148ce848a0e8db9b31b8e (table test-table [id=d4e0e9b145d14f548d6857f88dd512e2]) successfully deleted
I20260811 02:33:18.953140 4110 ts_tablet_manager.cc:1918] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:33:18.953238 4110 log.cc:1196] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/cb3c558f30d148ce848a0e8db9b31b8e
I20260811 02:33:18.953478 4110 ts_tablet_manager.cc:1939] T cb3c558f30d148ce848a0e8db9b31b8e P ddde21166ecd410c832900ce4f467498: Deleting consensus metadata
I20260811 02:33:18.953883 3177 catalog_manager.cc:4841] TS ddde21166ecd410c832900ce4f467498 (127.17.79.2:44781): tablet cb3c558f30d148ce848a0e8db9b31b8e (table test-table [id=d4e0e9b145d14f548d6857f88dd512e2]) successfully deleted
W20260811 02:33:18.957840 3172 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:33395 (error 108)
I20260811 02:33:18.958135 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 3551
I20260811 02:33:18.968384 4061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:33:18.968197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33395 (local address 127.0.0.1:56632)
0811 02:33:18.968273 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 02:33:18.968344 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 02:33:18.968593 3172 catalog_manager.cc:4584] TS 07100284419e4c11a0ef06c3ed71be1e (127.17.79.1:33395): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb3c558f30d148ce848a0e8db9b31b8e: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33395: connect: Connection refused (error 111)
I20260811 02:33:18.973829 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 3810
I20260811 02:33:19.006722 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 3142
2026-08-11T02:33:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2653 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:33:19 dist-test-slave-7nm7 krb5kdc[4118](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:33:19 dist-test-slave-7nm7 krb5kdc[4118](info): set up 2 sockets
Aug 11 02:33:19 dist-test-slave-7nm7 krb5kdc[4118](info): commencing operation
krb5kdc: starting...
W20260811 02:33:20.337746 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:33:20 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:33:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:33:20Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/rangeradmin_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/rangeradmin_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/rangerlookup_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/rangerlookup_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
I20260811 02:33:20.521281 17724 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskyYEYPK/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/postgres -l logfile start
2026-08-11 02:33:23.213 UTC [4174] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 02:33:23.213 UTC [4174] LOG: listening on IPv4 address "127.17.79.20", port 56789
2026-08-11 02:33:23.217 UTC [4174] LOG: listening on Unix socket "/tmp/.s.PGSQL.56789"
2026-08-11 02:33:23.246 UTC [4177] LOG: database system was shut down at 2026-08-11 02:33:21 UTC
2026-08-11 02:33:23.250 UTC [4174] LOG: database system is ready to accept connections
I20260811 02:33:24.483649 17724 mini_postgres.cc:96] Postgres bound to 56789
2026-08-11 02:33:24.494 UTC [4196] FATAL: database "slave" does not exist
127.17.79.20:56789 - accepting connections
I20260811 02:33:24.495012 17724 mini_ranger.cc:161] Starting Ranger...
I20260811 02:33:24.515951 17724 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 02:33:25.022583 17724 mini_ranger.cc:87] Created ranger Postgres database
I20260811 02:33:25.022671 17724 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-admin
2026-08-11 02:33:25,344 [I] DB FLAVOR :POSTGRES
2026-08-11 02:33:25,344 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 02:33:25,345 [I] Checking connection..
2026-08-11 02:33:25,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 02:33:25,593 [I] Checking connection passed.
2026-08-11 02:33:25,593 [I] --------- Verifying version history table ---------
2026-08-11 02:33:25,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 02:33:25,866 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 02:33:25,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 02:33:26,119 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 02:33:26,119 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 02:33:26,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 02:33:26.385 UTC [4305] WARNING: there is no transaction in progress
2026-08-11 02:33:26,392 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 02:33:26,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 02:33:26,676 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 02:33:26,676 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 02:33:26,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 02:33:26,941 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 02:33:27,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7nm7.c.gcp-upstream.internal','N') ;"
2026-08-11 02:33:27,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 02:33:27,759 [I] Table x_portal_user does not exist in database ranger
2026-08-11 02:33:27,760 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 02:33:28,033 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 02:33:28,033 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 02:33:28,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 02:33:28,554 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 02:33:28,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 02:33:29.590 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.606 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.623 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.639 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.656 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.674 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.726 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.733 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.747 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.757 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.767 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.781 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.791 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.797 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.805 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:29.812 UTC [4494] WARNING: there is no transaction in progress
2026-08-11 02:33:30,502 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 02:33:30,502 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 02:33:30,761 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 02:33:30,762 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 02:33:31,029 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 02:33:31,029 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 02:33:31,305 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 02:33:31,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 02:33:31,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 02:33:31,837 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7nm7.c.gcp-upstream.internal';"
2026-08-11 02:33:32,101 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 02:33:32,101 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 02:33:32,359 [I] DB_PATCHES have already been applied
I20260811 02:33:32.365074 17724 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-admin:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskyYEYPK/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 02:33:32.365149 17724 mini_ranger.cc:193] Using host: 127.17.79.20
I20260811 02:33:32.368994 17724 mini_ranger.cc:227] Ranger admin URL: http://127.17.79.20:46581
Aug 11, 2026 2:33:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:33:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:33:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 2:33:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 2:33:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 2:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 2:33:33 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 02:33:33.822582 17724 mini_ranger.cc:160] Time spent starting Ranger: real 9.328s user 0.005s sys 0.006s
Aug 11, 2026 2:33:54 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 2:33:54 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 2:33:54 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 2:33:54 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 2:33:55 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 02:33:55.687458 17724 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/rangerkms_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/rangerkms_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.79.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.79.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 02:33:55 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415635, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 02:33:55.773710 17724 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 02:33:55.784827 17724 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 02:33:56.667393 17724 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 02:33:56.667486 17724 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms
I20260811 02:33:56.667510 17724 mini_ranger_kms.cc:227] Using postgres at 127.17.79.20:56789
2026-08-11 02:33:57,314 [I] DB FLAVOR :POSTGRES
2026-08-11 02:33:57,314 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 02:33:57,314 [I] Checking connection
2026-08-11 02:33:57,314 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 02:33:57,642 [I] connection success
2026-08-11 02:33:57,642 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 02:33:57,643 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 02:33:57,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 02:33:57,918 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 02:33:57,918 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 02:33:57,919 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 02:33:57,919 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:56789/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 02:33:58,232 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 02:33:58.744858 17724 mini_ranger_kms.cc:310] Created kms service
I20260811 02:33:58.978864 17724 mini_ranger_kms.cc:326] Created kudu user
I20260811 02:33:59.024621 17724 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 02:33:59 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415635, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:33:59.480300 17724 mini_ranger_kms.cc:384] Added ranger policy
I20260811 02:33:59.480428 17724 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms:/tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 02:33:59.480455 17724 mini_ranger_kms.cc:240] Using host: 127.17.79.20
I20260811 02:33:59.485965 17724 mini_ranger_kms.cc:276] Ranger KMS PID: 4804
I20260811 02:33:59.486110 17724 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.79.20:48981
Aug 11, 2026 2:34:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:34:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:34:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 2:34:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 2:34:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 2:34:00 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 02:34:01 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786415641, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.79.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 02:34:02 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415641, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.79.20@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:02.424638 17724 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.651s user 0.020s sys 0.286s
I20260811 02:34:02.424765 17724 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 02:34:02.424840 17724 mini_ranger_kms.cc:401] 127.17.79.20:48981/kms/v1/keys
Aug 11 02:34:02 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415641, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.79.20@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
Aug 11 02:34:05 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:34:05.101832 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44541
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:44541
--ranger_config_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:48981/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:05.194485 4900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:05.194703 4900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:05.194726 4900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:05.196391 4900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:34:05.196489 4900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:05.196527 4900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:05.196558 4900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:34:05.196589 4900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:34:05.198930 4900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.79.20:48981/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:44541
--ranger_config_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:05.199321 4900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:05.199579 4900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:05.206024 4909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:05.206249 4918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:05.206382 4913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:05.207913 4900 server_base.cc:1034] running on GCE node
I20260811 02:34:05.208218 4900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:05.208572 4900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:05.209722 4900 hybrid_clock.cc:648] HybridClock initialized: now 1786415645209696 us; error 43 us; skew 500 ppm
Aug 11 02:34:05 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415645, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:05.213560 4900 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:34:05.214293 4900 webserver.cc:460] Webserver started at http://127.17.79.62:36943/ using document root <none> and password file <none>
I20260811 02:34:05.214572 4900 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:05.214627 4900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:05.214766 4900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:05 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415645, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:05.270175 4900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "cc1fe46e8dc54c9e8746d46598bce007"
format_stamp: "Formatted at 2026-08-11 02:34:05 on dist-test-slave-7nm7"
server_key: "cd8f325408ae078b52603d442fe0066f"
server_key_iv: "837b9409df3d3a02b6e494683010491e"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:05.270728 4900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "cc1fe46e8dc54c9e8746d46598bce007"
format_stamp: "Formatted at 2026-08-11 02:34:05 on dist-test-slave-7nm7"
server_key: "cd8f325408ae078b52603d442fe0066f"
server_key_iv: "837b9409df3d3a02b6e494683010491e"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:05.272289 4900 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:34:05.284950 4932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:05.285166 4900 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:34:05.285411 4900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "cc1fe46e8dc54c9e8746d46598bce007"
format_stamp: "Formatted at 2026-08-11 02:34:05 on dist-test-slave-7nm7"
server_key: "cd8f325408ae078b52603d442fe0066f"
server_key_iv: "837b9409df3d3a02b6e494683010491e"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:05.285569 4900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:05.302857 4900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:05.305007 4900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:05.305197 4900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:05.310725 4900 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:44541
I20260811 02:34:05.310751 5027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:44541 every 8 connection(s)
I20260811 02:34:05.311154 4900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:34:05.312049 5031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:05.315487 5031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007: Bootstrap starting.
I20260811 02:34:05.315917 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 4900
I20260811 02:34:05.316045 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:34:05.316313 5031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:05.316259 17724 external_mini_cluster.cc:1428] Setting key e7a5187e22842da1784a176e05ca2c45
I20260811 02:34:05.316660 5031 log.cc:824] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:05.317688 5031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007: No bootstrap required, opened a new log
I20260811 02:34:05.319525 5031 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1fe46e8dc54c9e8746d46598bce007" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44541 } }
I20260811 02:34:05.319705 5031 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:05.319741 5031 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1fe46e8dc54c9e8746d46598bce007, State: Initialized, Role: FOLLOWER
I20260811 02:34:05.319859 5031 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1fe46e8dc54c9e8746d46598bce007" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44541 } }
I20260811 02:34:05.319938 5031 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:34:05.319967 5031 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:34:05.320010 5031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:05.320673 5031 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1fe46e8dc54c9e8746d46598bce007" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44541 } }
I20260811 02:34:05.320778 5031 leader_election.cc:302] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc1fe46e8dc54c9e8746d46598bce007; no voters:
I20260811 02:34:05.320987 5031 leader_election.cc:288] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:34:05.321012 5036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:34:05.321283 5036 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [term 1 LEADER]: Becoming Leader. State: Replica: cc1fe46e8dc54c9e8746d46598bce007, State: Running, Role: LEADER
I20260811 02:34:05.321378 5031 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:34:05.321415 5036 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1fe46e8dc54c9e8746d46598bce007" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44541 } }
I20260811 02:34:05.321799 5036 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc1fe46e8dc54c9e8746d46598bce007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1fe46e8dc54c9e8746d46598bce007" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44541 } } }
I20260811 02:34:05.321991 5036 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:05.322206 5036 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc1fe46e8dc54c9e8746d46598bce007. Latest consensus state: current_term: 1 leader_uuid: "cc1fe46e8dc54c9e8746d46598bce007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1fe46e8dc54c9e8746d46598bce007" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44541 } } }
I20260811 02:34:05.322355 5036 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:05.322520 5050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:34:05.323076 5050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:34:05.323586 5031 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 11 02:34:05 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:05.325901 5050 catalog_manager.cc:1347] Generated new cluster ID: 81c2df022ea348d288641f4ffc3ba56c
I20260811 02:34:05.326247 5050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:34:05.334851 5035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:05.317122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34412 (local address 127.17.79.62:44541)
0811 02:34:05.317311 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:05.317320 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:05.317353 (+ 33us) server_negotiation.cc:407] Connection header received
0811 02:34:05.317942 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:05.317952 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:05.318013 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:05.318178 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:05.319011 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:05.320831 (+ 1820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:05.321975 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:05.322643 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:05.322755 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:05.325879 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:05.325884 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:05.325884 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:05.325896 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:05.331951 (+ 6055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:05.332474 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:05.332478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:05.332478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:05.332622 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:05.332863 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:05.332863 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:05.332864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:05.333320 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:05.333507 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:05.333980 (+ 473us) server_negotiation.cc:299] Negotiation successful
0811 02:34:05.334342 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
I20260811 02:34:05.338274 5050 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:34:05.339049 5050 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:34:05.346400 5050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007: Generated new TSK 0
I20260811 02:34:05.346674 5050 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:34:06.065349 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:48981/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44541
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:06.177812 5109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:06.178048 5109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:06.178092 5109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:06.179391 5109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:06.179462 5109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:06.179513 5109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:34:06.181111 5109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.79.20:48981/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:06.181387 5109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:06.181661 5109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:06.187423 5120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:06.187448 5122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:06.187592 5119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:06.188141 5109 server_base.cc:1034] running on GCE node
I20260811 02:34:06.188351 5109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:06.188607 5109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:06.191913 5109 hybrid_clock.cc:648] HybridClock initialized: now 1786415646191886 us; error 34 us; skew 500 ppm
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:06.195470 5109 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:34:06.196014 5109 webserver.cc:460] Webserver started at http://127.17.79.1:42561/ using document root <none> and password file <none>
I20260811 02:34:06.196300 5109 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:06.196385 5109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:06.196552 5109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:06.211959 5109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "644bdfefea8543f3b492f174504b9a33"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "106996a08fd51c18c1df0c1dbc48abe7"
server_key_iv: "2a8fd976b426b8344b2c21c3464c4347"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.212437 5109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "644bdfefea8543f3b492f174504b9a33"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "106996a08fd51c18c1df0c1dbc48abe7"
server_key_iv: "2a8fd976b426b8344b2c21c3464c4347"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.217849 5109 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 02:34:06.238866 5135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.239169 5109 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 02:34:06.239283 5109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "644bdfefea8543f3b492f174504b9a33"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "106996a08fd51c18c1df0c1dbc48abe7"
server_key_iv: "2a8fd976b426b8344b2c21c3464c4347"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.239394 5109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:06.253266 5109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:06.255926 5109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:06.256088 5109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:06.256321 5109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:06.256742 5109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:06.256796 5109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.256830 5109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:06.256880 5109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.264784 5109 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:33379
I20260811 02:34:06.264859 5334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:33379 every 8 connection(s)
I20260811 02:34:06.265372 5109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:06.274358 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 5109
I20260811 02:34:06.274461 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:34:06.274658 17724 external_mini_cluster.cc:1428] Setting key 3a43bc8aa5ff3632ebf52637966281cd
I20260811 02:34:06.278517 5341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.266527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:38227 (local address 127.17.79.62:44541)
0811 02:34:06.266684 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.266686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.266919 (+ 233us) server_negotiation.cc:407] Connection header received
0811 02:34:06.267557 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.267558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.267576 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.267667 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:06.268371 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.269187 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.270750 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.271074 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.271163 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.274298 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:06.274299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:06.274300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:06.274308 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:06.276676 (+ 2368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.277216 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.277217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.277217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.277288 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.277602 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.277603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.277604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.277765 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:06.277835 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.278316 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.278415 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260811 02:34:06.279301 5338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.266493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44541 (local address 127.17.79.1:38227)
0811 02:34:06.266756 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.266805 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.267419 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.267734 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.267738 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.267983 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:06.268266 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.268272 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.269287 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.269288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.270656 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.270659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.271189 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.271190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.271335 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.271998 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:06.272008 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:06.274075 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:06.276795 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:06.276802 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:06.276805 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:06.277124 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:06.277378 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:06.277379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:06.277379 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:06.277520 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:06.277866 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:06.277874 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:06.278064 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.278186 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.279057 (+ 871us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":88,"threads_started":1}
I20260811 02:34:06.280040 5335 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44541
I20260811 02:34:06.280158 5335 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:06.280362 5335 heartbeater.cc:511] Master 127.17.79.62:44541 requested a full tablet report, sending...
I20260811 02:34:06.281014 4964 ts_manager.cc:194] Registered new tserver with Master: 644bdfefea8543f3b492f174504b9a33 (127.17.79.1:33379)
I20260811 02:34:06.281939 4964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:38227
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:34:06.315450 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:48981/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44541
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 02:34:06.416818 5350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:06.417174 5350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:06.417258 5350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:06.419049 5350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:06.419164 5350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:06.419252 5350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:34:06.421345 5350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.79.20:48981/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:06.421828 5350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:06.422188 5350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:06.431205 5357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:06.431289 5367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:06.431329 5359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:06.431510 5350 server_base.cc:1034] running on GCE node
I20260811 02:34:06.431864 5350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:06.432096 5350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:06.433272 5350 hybrid_clock.cc:648] HybridClock initialized: now 1786415646433257 us; error 28 us; skew 500 ppm
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:06.436736 5350 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:34:06.437376 5350 webserver.cc:460] Webserver started at http://127.17.79.2:37867/ using document root <none> and password file <none>
I20260811 02:34:06.437650 5350 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:06.437724 5350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:06.437870 5350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:06.454788 5350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "efbbcebcab124ec1acc5ea839e1cd119"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "16707cd3ba78b4764648f98413a1465b"
server_key_iv: "c411d52666d96292be772f5c29b0b06b"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.455233 5350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "efbbcebcab124ec1acc5ea839e1cd119"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "16707cd3ba78b4764648f98413a1465b"
server_key_iv: "c411d52666d96292be772f5c29b0b06b"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.457120 5350 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 02:34:06.469709 5380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.470005 5350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:34:06.470117 5350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "efbbcebcab124ec1acc5ea839e1cd119"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "16707cd3ba78b4764648f98413a1465b"
server_key_iv: "c411d52666d96292be772f5c29b0b06b"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.470211 5350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:06.483345 5350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:06.485754 5350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:06.485913 5350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:06.486152 5350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:06.486591 5350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:06.486686 5350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.486747 5350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:06.486791 5350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.494802 5350 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:42139
I20260811 02:34:06.495309 5350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:34:06.496316 5571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:42139 every 8 connection(s)
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:06.505263 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 5350
I20260811 02:34:06.505370 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:34:06.505576 17724 external_mini_cluster.cc:1428] Setting key 3c5a56f990529e5c6c62d3ae398b6c71
I20260811 02:34:06.510115 5341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.496139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:41915 (local address 127.17.79.62:44541)
0811 02:34:06.496192 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.496194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.498536 (+ 2342us) server_negotiation.cc:407] Connection header received
0811 02:34:06.499226 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.499227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.499241 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.499324 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:06.500077 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.500895 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.502407 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.502733 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.502805 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.506438 (+ 3633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:06.506440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:06.506440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:06.506448 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:06.508233 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.508883 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.508884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.508884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.508947 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.509269 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.509271 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.509271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.509418 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:06.509475 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.509907 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.510016 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:34:06.510522 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.496153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44541 (local address 127.17.79.2:41915)
0811 02:34:06.498367 (+ 2214us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.498420 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.499067 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.499415 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.499420 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.499687 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:06.499962 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.499968 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.501009 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.501011 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.502298 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.502302 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.502835 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.502836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.502982 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.503637 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:06.503649 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:06.506189 (+ 2540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:06.508375 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:06.508383 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:06.508386 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:06.508786 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:06.509023 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:06.509024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:06.509024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:06.509182 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:06.509514 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:06.509521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:06.509713 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.509833 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.510002 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2162,"thread_start_us":86,"threads_started":1}
I20260811 02:34:06.511408 5574 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44541
I20260811 02:34:06.511507 5574 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:06.511706 5574 heartbeater.cc:511] Master 127.17.79.62:44541 requested a full tablet report, sending...
I20260811 02:34:06.512064 4964 ts_manager.cc:194] Registered new tserver with Master: efbbcebcab124ec1acc5ea839e1cd119 (127.17.79.2:42139)
I20260811 02:34:06.512637 4964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:41915
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:34:06.537964 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:48981/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44541
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:06.633701 5582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:06.633931 5582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:06.633973 5582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:06.635265 5582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:06.635326 5582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:06.635371 5582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:34:06.636912 5582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.79.20:48981/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:44541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:06.637164 5582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:06.637411 5582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:06.643759 5594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:06.643687 5592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:06.644106 5591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:06.644709 5582 server_base.cc:1034] running on GCE node
I20260811 02:34:06.645028 5582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:06.645237 5582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:06.646397 5582 hybrid_clock.cc:648] HybridClock initialized: now 1786415646646384 us; error 25 us; skew 500 ppm
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:06.649901 5582 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:34:06.650480 5582 webserver.cc:460] Webserver started at http://127.17.79.3:38889/ using document root <none> and password file <none>
I20260811 02:34:06.650805 5582 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:06.650868 5582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:06.650998 5582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:06.667850 5582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "06a96bdf9f3d497b818c8b68535dbc7f"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "124d1f408403b3dc77b32e7cba5964b6"
server_key_iv: "29110132bb860d5781fdbe1f067b9af1"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.668467 5582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "06a96bdf9f3d497b818c8b68535dbc7f"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "124d1f408403b3dc77b32e7cba5964b6"
server_key_iv: "29110132bb860d5781fdbe1f067b9af1"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.673921 5582 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 02:34:06.699584 5605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.699792 5582 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:34:06.699879 5582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "06a96bdf9f3d497b818c8b68535dbc7f"
format_stamp: "Formatted at 2026-08-11 02:34:06 on dist-test-slave-7nm7"
server_key: "124d1f408403b3dc77b32e7cba5964b6"
server_key_iv: "29110132bb860d5781fdbe1f067b9af1"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:06.699990 5582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:06.736816 5582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:06.740352 5582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:06.740603 5582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:06.740964 5582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:06.741413 5582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:06.741505 5582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.741586 5582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:06.741649 5582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:06.750946 5582 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:33075
I20260811 02:34:06.751343 5582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:34:06.752187 5802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:33075 every 8 connection(s)
I20260811 02:34:06.754424 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 5582
I20260811 02:34:06.754534 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:34:06.754736 17724 external_mini_cluster.cc:1428] Setting key 3867356aae2999f65d99045690734e9c
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:06.764246 5341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.752519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:50411 (local address 127.17.79.62:44541)
0811 02:34:06.752561 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.752563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.752650 (+ 87us) server_negotiation.cc:407] Connection header received
0811 02:34:06.753200 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.753202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.753226 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.753264 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:06.755317 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.756105 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.757575 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.757894 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.757943 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.760458 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:06.760459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:06.760460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:06.760467 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:06.762301 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.762781 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.762782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.762783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.762843 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.763105 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.763106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.763106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.763345 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:06.763412 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.763926 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.764054 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:34:06.764317 5811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.752230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:44541 (local address 127.17.79.3:50411)
0811 02:34:06.752525 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.752569 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.753086 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.754568 (+ 1482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.754573 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.754849 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:06.755206 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.755213 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.756233 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.756234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.757468 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.757471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.758042 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.758043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.758183 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.758867 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:06.758878 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:06.760344 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:06.762397 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:06.762404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:06.762406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:06.762686 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:06.762914 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:06.762915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:06.762915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:06.763035 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:06.763474 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:06.763482 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:06.763675 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.763868 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.764056 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":82,"threads_started":1}
I20260811 02:34:06.764853 5804 heartbeater.cc:347] Connected to a master server at 127.17.79.62:44541
I20260811 02:34:06.765012 5804 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:06.765282 5804 heartbeater.cc:511] Master 127.17.79.62:44541 requested a full tablet report, sending...
I20260811 02:34:06.765774 4964 ts_manager.cc:194] Registered new tserver with Master: 06a96bdf9f3d497b818c8b68535dbc7f (127.17.79.3:33075)
I20260811 02:34:06.766291 4964 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:50411
I20260811 02:34:06.766953 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:34:06.777488 5341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.768723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34422 (local address 127.17.79.62:44541)
0811 02:34:06.768769 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.768771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.770414 (+ 1643us) server_negotiation.cc:407] Connection header received
0811 02:34:06.770469 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.770470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.770482 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.770552 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:06.771231 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.771943 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.772645 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.772932 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.773013 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.774696 (+ 1683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:06.774698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:06.774698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:06.774705 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:06.776288 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.776643 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.776645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.776645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.776708 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:06.776938 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:06.776939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:06.776939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:06.777058 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:06.777164 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.777294 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.777371 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:34:06.779732 4964 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:34:06.782497 4964 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:34:06.795529 5829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.786145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:42139 (local address 127.0.0.1:58716)
0811 02:34:06.790343 (+ 4198us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.790369 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.790428 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.791189 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.791190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.791192 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:06.791330 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.791334 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.792862 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.792863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.794264 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.794267 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.795240 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.795241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.795323 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.795337 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.795385 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.795441 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4180,"mutex_wait_us":60,"thread_start_us":96,"threads_started":1}
I20260811 02:34:06.795643 5830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.785998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41802 (local address 127.17.79.1:33379)
0811 02:34:06.790684 (+ 4686us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.790690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.790702 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:34:06.790755 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.790757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.790773 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.790846 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:06.791910 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.793035 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.794382 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.795165 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.795219 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.795283 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.795522 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.795565 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4648,"thread_start_us":87,"threads_started":1}
I20260811 02:34:06.795933 5831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.786336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:33075 (local address 127.0.0.1:33004)
0811 02:34:06.790508 (+ 4172us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.790514 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.790575 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.790918 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.790921 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.790924 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:06.791005 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.791007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.792827 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.792828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.794545 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.794547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.795587 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.795588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.795771 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.795776 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.795821 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.795859 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4162,"mutex_wait_us":88,"thread_start_us":98,"threads_started":1}
I20260811 02:34:06.796257 5832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.785907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33379 (local address 127.0.0.1:41802)
0811 02:34:06.790321 (+ 4414us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.790366 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.790433 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.791763 (+ 1330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.791764 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.791766 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:06.791809 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.791810 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.793141 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.793142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.794272 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.794276 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.795354 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.795355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.795420 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.795424 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.795781 (+ 357us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.795829 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4375,"thread_start_us":79,"threads_started":1}
I20260811 02:34:06.796353 5834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.786576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58716 (local address 127.17.79.2:42139)
0811 02:34:06.791013 (+ 4437us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.791018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.791027 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:34:06.791066 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.791069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.791085 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.791453 (+ 368us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:06.791545 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.792774 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.794379 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.795136 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.796026 (+ 890us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.796119 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.796151 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.796201 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4394,"thread_start_us":82,"threads_started":1}
I20260811 02:34:06.797003 5835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.786685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33004 (local address 127.17.79.3:33075)
0811 02:34:06.786883 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.786888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.790585 (+ 3697us) server_negotiation.cc:407] Connection header received
0811 02:34:06.790652 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.790655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.790673 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.790751 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:06.791543 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.792725 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.794662 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.795427 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.795487 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.795552 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.796868 (+ 1316us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.796915 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":125,"threads_started":1}
I20260811 02:34:06.797179 5419 tablet_service.cc:1467] Processing CreateTablet for tablet 28ad5d5b18e54b80912f39a9556215bc (DEFAULT_TABLE table=test-table [id=9bdd57474b6f402d959b6fe0f82a6f95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:34:06.797612 5419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28ad5d5b18e54b80912f39a9556215bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:06.799012 5685 tablet_service.cc:1467] Processing CreateTablet for tablet 28ad5d5b18e54b80912f39a9556215bc (DEFAULT_TABLE table=test-table [id=9bdd57474b6f402d959b6fe0f82a6f95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:34:06.799371 5685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28ad5d5b18e54b80912f39a9556215bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:06.801436 5836 tablet_bootstrap.cc:492] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Bootstrap starting.
I20260811 02:34:06.802541 5836 tablet_bootstrap.cc:654] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:06.802881 5836 log.cc:824] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:06.802822 5191 tablet_service.cc:1467] Processing CreateTablet for tablet 28ad5d5b18e54b80912f39a9556215bc (DEFAULT_TABLE table=test-table [id=9bdd57474b6f402d959b6fe0f82a6f95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:34:06.803162 5191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28ad5d5b18e54b80912f39a9556215bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:06.803625 5836 tablet_bootstrap.cc:492] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: No bootstrap required, opened a new log
I20260811 02:34:06.803684 5836 ts_tablet_manager.cc:1397] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:34:06.805760 5836 raft_consensus.cc:348] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.805938 5836 raft_consensus.cc:374] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:06.805974 5836 raft_consensus.cc:729] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efbbcebcab124ec1acc5ea839e1cd119, State: Initialized, Role: FOLLOWER
I20260811 02:34:06.806095 5836 consensus_queue.cc:260] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.806398 5836 ts_tablet_manager.cc:1428] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:34:06.806538 5574 heartbeater.cc:503] Master 127.17.79.62:44541 was elected leader, sending a full tablet report...
I20260811 02:34:06.808176 5843 tablet_bootstrap.cc:492] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Bootstrap starting.
I20260811 02:34:06.808434 5840 tablet_bootstrap.cc:492] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33: Bootstrap starting.
I20260811 02:34:06.809528 5843 tablet_bootstrap.cc:654] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:06.809525 5840 tablet_bootstrap.cc:654] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:06.809932 5843 log.cc:824] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:06.809932 5840 log.cc:824] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:06.810793 5840 tablet_bootstrap.cc:492] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33: No bootstrap required, opened a new log
I20260811 02:34:06.810801 5843 tablet_bootstrap.cc:492] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: No bootstrap required, opened a new log
I20260811 02:34:06.810864 5840 ts_tablet_manager.cc:1397] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:34:06.810864 5843 ts_tablet_manager.cc:1397] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:34:06.813453 5843 raft_consensus.cc:348] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.813623 5843 raft_consensus.cc:374] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:06.813657 5843 raft_consensus.cc:729] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a96bdf9f3d497b818c8b68535dbc7f, State: Initialized, Role: FOLLOWER
I20260811 02:34:06.813580 5840 raft_consensus.cc:348] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.813707 5840 raft_consensus.cc:374] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:06.813738 5840 raft_consensus.cc:729] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644bdfefea8543f3b492f174504b9a33, State: Initialized, Role: FOLLOWER
I20260811 02:34:06.813810 5843 consensus_queue.cc:260] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.814100 5843 ts_tablet_manager.cc:1428] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:34:06.814107 5840 consensus_queue.cc:260] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.814301 5804 heartbeater.cc:503] Master 127.17.79.62:44541 was elected leader, sending a full tablet report...
I20260811 02:34:06.814759 5840 ts_tablet_manager.cc:1428] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 02:34:06.814929 5335 heartbeater.cc:503] Master 127.17.79.62:44541 was elected leader, sending a full tablet report...
I20260811 02:34:06.852175 5839 raft_consensus.cc:482] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:34:06.852330 5839 raft_consensus.cc:504] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.852741 5839 leader_election.cc:288] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644bdfefea8543f3b492f174504b9a33 (127.17.79.1:33379), 06a96bdf9f3d497b818c8b68535dbc7f (127.17.79.3:33075)
I20260811 02:34:06.857069 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.852962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:33075 (local address 127.17.79.2:42783)
0811 02:34:06.853075 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.853088 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.853132 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.853736 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.853737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.853740 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:06.853814 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.853816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.854812 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.854813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.856025 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.856029 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.856791 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.856793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.856871 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.856874 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.856924 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.856975 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":2}
I20260811 02:34:06.857097 5830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.853518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:40961 (local address 127.17.79.1:33379)
0811 02:34:06.853579 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.853581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.853834 (+ 253us) server_negotiation.cc:407] Connection header received
0811 02:34:06.853934 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.853935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.853948 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.853976 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:06.854177 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.854861 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.856137 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.856735 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.856775 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.856785 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.856978 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.857022 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 02:34:06.857307 5835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.853517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:42783 (local address 127.17.79.3:33075)
0811 02:34:06.853569 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.853572 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.853581 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:34:06.853611 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.853612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.853623 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.853678 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:06.853898 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.854702 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.856131 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.856672 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.856742 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.856755 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.857162 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.857209 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:34:06.857635 5730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28ad5d5b18e54b80912f39a9556215bc" candidate_uuid: "efbbcebcab124ec1acc5ea839e1cd119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" is_pre_election: true
I20260811 02:34:06.857790 5730 raft_consensus.cc:2454] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efbbcebcab124ec1acc5ea839e1cd119 in term 0.
I20260811 02:34:06.857767 5852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.853285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33379 (local address 127.17.79.2:40961)
0811 02:34:06.853772 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.853784 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:06.853859 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:06.854034 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:06.854035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:06.854036 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:06.854104 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.854105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.854946 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.854946 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.856035 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:06.856037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.856838 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.856839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:06.856900 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.856903 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:34:06.857625 (+ 722us) client_negotiation.cc:240] Negotiation successful
0811 02:34:06.857673 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":103,"threads_started":1}
I20260811 02:34:06.858107 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28ad5d5b18e54b80912f39a9556215bc" candidate_uuid: "efbbcebcab124ec1acc5ea839e1cd119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644bdfefea8543f3b492f174504b9a33" is_pre_election: true
I20260811 02:34:06.858294 5254 raft_consensus.cc:2454] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efbbcebcab124ec1acc5ea839e1cd119 in term 0.
I20260811 02:34:06.858295 5384 leader_election.cc:302] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a96bdf9f3d497b818c8b68535dbc7f, efbbcebcab124ec1acc5ea839e1cd119; no voters:
I20260811 02:34:06.858425 5839 raft_consensus.cc:2781] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:34:06.858469 5839 raft_consensus.cc:482] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:34:06.858490 5839 raft_consensus.cc:3037] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:06.859454 5839 raft_consensus.cc:504] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.859619 5839 leader_election.cc:288] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [CANDIDATE]: Term 1 election: Requested vote from peers 644bdfefea8543f3b492f174504b9a33 (127.17.79.1:33379), 06a96bdf9f3d497b818c8b68535dbc7f (127.17.79.3:33075)
I20260811 02:34:06.859800 5254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28ad5d5b18e54b80912f39a9556215bc" candidate_uuid: "efbbcebcab124ec1acc5ea839e1cd119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644bdfefea8543f3b492f174504b9a33"
I20260811 02:34:06.859889 5254 raft_consensus.cc:3037] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:06.859896 5730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28ad5d5b18e54b80912f39a9556215bc" candidate_uuid: "efbbcebcab124ec1acc5ea839e1cd119" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a96bdf9f3d497b818c8b68535dbc7f"
I20260811 02:34:06.859966 5730 raft_consensus.cc:3037] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:06.860821 5254 raft_consensus.cc:2454] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efbbcebcab124ec1acc5ea839e1cd119 in term 1.
I20260811 02:34:06.860859 5730 raft_consensus.cc:2454] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efbbcebcab124ec1acc5ea839e1cd119 in term 1.
I20260811 02:34:06.861016 5384 leader_election.cc:302] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a96bdf9f3d497b818c8b68535dbc7f, efbbcebcab124ec1acc5ea839e1cd119; no voters:
I20260811 02:34:06.861135 5839 raft_consensus.cc:2781] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:34:06.861306 5839 raft_consensus.cc:686] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 1 LEADER]: Becoming Leader. State: Replica: efbbcebcab124ec1acc5ea839e1cd119, State: Running, Role: LEADER
I20260811 02:34:06.861425 5839 consensus_queue.cc:237] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } }
I20260811 02:34:06.862221 4962 catalog_manager.cc:5495] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 reported cstate change: term changed from 0 to 1, leader changed from <none> to efbbcebcab124ec1acc5ea839e1cd119 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "efbbcebcab124ec1acc5ea839e1cd119" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efbbcebcab124ec1acc5ea839e1cd119" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 } health_report { overall_health: UNKNOWN } } }
I20260811 02:34:06.868332 5834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.865831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58722 (local address 127.17.79.2:42139)
0811 02:34:06.865872 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:06.865874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:06.865897 (+ 23us) server_negotiation.cc:407] Connection header received
0811 02:34:06.865983 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:06.865984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:06.866003 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:06.866089 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:34:06.866267 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.866725 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.867499 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:06.867759 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:06.867832 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:06.868001 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:34:06.868106 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:34:06.868205 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:06.868238 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 02:34:06.868256 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:34:06.870250 5730 raft_consensus.cc:1261] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 1 FOLLOWER]: Refusing update from remote peer efbbcebcab124ec1acc5ea839e1cd119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:34:06.870216 5254 raft_consensus.cc:1261] T 28ad5d5b18e54b80912f39a9556215bc P 644bdfefea8543f3b492f174504b9a33 [term 1 FOLLOWER]: Refusing update from remote peer efbbcebcab124ec1acc5ea839e1cd119: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:34:06.870569 5839 consensus_queue.cc:1035] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644bdfefea8543f3b492f174504b9a33" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:34:06.870890 5839 consensus_queue.cc:1035] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a96bdf9f3d497b818c8b68535dbc7f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:34:06.874769 5860 mvcc.cc:205] Tried to move back new op lower bound from 7317158489577885696 to 7317158489545035776. Current Snapshot: MvccSnapshot[applied={T|T < 7317158489577885696}]
I20260811 02:34:06.875313 5867 mvcc.cc:205] Tried to move back new op lower bound from 7317158489577885696 to 7317158489545035776. Current Snapshot: MvccSnapshot[applied={T|T < 7317158489577885696}]
I20260811 02:34:06.876860 5862 mvcc.cc:205] Tried to move back new op lower bound from 7317158489577885696 to 7317158489545035776. Current Snapshot: MvccSnapshot[applied={T|T < 7317158489577885696}]
I20260811 02:34:06.879326 4962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:34:06.879419 4962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:34:06.880455 4962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc1fe46e8dc54c9e8746d46598bce007: Sending DeleteTablet for 3 replicas of tablet 28ad5d5b18e54b80912f39a9556215bc
I20260811 02:34:06.880784 5191 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ad5d5b18e54b80912f39a9556215bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:34:06 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41802
I20260811 02:34:06.881253 5419 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ad5d5b18e54b80912f39a9556215bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:34:06 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:58716
I20260811 02:34:06.881472 5685 tablet_service.cc:1514] Processing DeleteTablet for tablet 28ad5d5b18e54b80912f39a9556215bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:34:06 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:33004
I20260811 02:34:06.882118 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 5109
I20260811 02:34:06.890065 5882 tablet_replica.cc:330] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: stopping tablet replica
I20260811 02:34:06.890327 5883 tablet_replica.cc:330] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: stopping tablet replica
I20260811 02:34:06.890566 5882 raft_consensus.cc:2229] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:34:06.890760 5883 raft_consensus.cc:2229] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:34:06.890987 5882 raft_consensus.cc:2258] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:34:06.891165 5883 raft_consensus.cc:2258] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:34:06.891918 5883 ts_tablet_manager.cc:1905] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:34:06.892367 5882 ts_tablet_manager.cc:1905] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:34:06.895860 5883 ts_tablet_manager.cc:1918] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:34:06.896073 5882 ts_tablet_manager.cc:1918] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:34:06.896204 5882 log.cc:1196] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/28ad5d5b18e54b80912f39a9556215bc
I20260811 02:34:06.896366 5883 log.cc:1196] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/28ad5d5b18e54b80912f39a9556215bc
I20260811 02:34:06.896726 5882 ts_tablet_manager.cc:1939] T 28ad5d5b18e54b80912f39a9556215bc P efbbcebcab124ec1acc5ea839e1cd119: Deleting consensus metadata
I20260811 02:34:06.897230 4935 catalog_manager.cc:4841] TS efbbcebcab124ec1acc5ea839e1cd119 (127.17.79.2:42139): tablet 28ad5d5b18e54b80912f39a9556215bc (table test-table [id=9bdd57474b6f402d959b6fe0f82a6f95]) successfully deleted
I20260811 02:34:06.897747 5883 ts_tablet_manager.cc:1939] T 28ad5d5b18e54b80912f39a9556215bc P 06a96bdf9f3d497b818c8b68535dbc7f: Deleting consensus metadata
I20260811 02:34:06.898169 4935 catalog_manager.cc:4841] TS 06a96bdf9f3d497b818c8b68535dbc7f (127.17.79.3:33075): tablet 28ad5d5b18e54b80912f39a9556215bc (table test-table [id=9bdd57474b6f402d959b6fe0f82a6f95]) successfully deleted
Aug 11 02:34:06 dist-test-slave-7nm7 krb5kdc[4118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415646, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
W20260811 02:34:06.919044 4941 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:33379 (error 108)
I20260811 02:34:06.921075 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 5350
I20260811 02:34:06.933331 5832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:06.933165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33379 (local address 127.0.0.1:41816)
0811 02:34:06.933235 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:06.933281 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 02:34:06.933667 4941 catalog_manager.cc:4584] TS 644bdfefea8543f3b492f174504b9a33 (127.17.79.1:33379): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 28ad5d5b18e54b80912f39a9556215bc: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33379: connect: Connection refused (error 111)
I20260811 02:34:06.938779 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 5582
I20260811 02:34:06.958959 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 4900
I20260811 02:34:06.978439 17724 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 02:34:07.333868 17724 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 02:34:07.333992 17724 mini_ranger.cc:66] Stopping Ranger...
I20260811 02:34:07.688932 17724 mini_ranger.cc:68] Stopped Ranger
2026-08-11 02:34:07.689 UTC [4174] LOG: received smart shutdown request
2026-08-11 02:34:07.693 UTC [4174] LOG: background worker "logical replication launcher" (PID 4193) exited with exit code 1
2026-08-11 02:34:07.693 UTC [4179] LOG: shutting down
2026-08-11 02:34:07.877 UTC [4174] LOG: database system is shut down
2026-08-11T02:34:07Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48969 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:34:08 dist-test-slave-7nm7 krb5kdc[5899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:34:08 dist-test-slave-7nm7 krb5kdc[5899](info): set up 2 sockets
Aug 11 02:34:08 dist-test-slave-7nm7 krb5kdc[5899](info): commencing operation
krb5kdc: starting...
W20260811 02:34:09.291934 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:34:09 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:34:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:34:09Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/rangeradmin_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/rangeradmin_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/rangerlookup_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/rangerlookup_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
I20260811 02:34:09.477341 17724 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskyYEYPK/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/postgres -l logfile start
2026-08-11 02:34:12.049 UTC [5959] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 02:34:12.049 UTC [5959] LOG: listening on IPv4 address "127.17.79.20", port 40995
2026-08-11 02:34:12.053 UTC [5959] LOG: listening on Unix socket "/tmp/.s.PGSQL.40995"
2026-08-11 02:34:12.084 UTC [5963] LOG: database system was shut down at 2026-08-11 02:34:10 UTC
2026-08-11 02:34:12.088 UTC [5959] LOG: database system is ready to accept connections
I20260811 02:34:13.306125 17724 mini_postgres.cc:96] Postgres bound to 40995
2026-08-11 02:34:13.313 UTC [5974] FATAL: database "slave" does not exist
127.17.79.20:40995 - accepting connections
I20260811 02:34:13.314481 17724 mini_ranger.cc:161] Starting Ranger...
I20260811 02:34:13.333603 17724 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 02:34:13.800848 17724 mini_ranger.cc:87] Created ranger Postgres database
I20260811 02:34:13.800940 17724 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-admin
2026-08-11 02:34:14,097 [I] DB FLAVOR :POSTGRES
2026-08-11 02:34:14,097 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 02:34:14,097 [I] Checking connection..
2026-08-11 02:34:14,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 02:34:14,383 [I] Checking connection passed.
2026-08-11 02:34:14,383 [I] --------- Verifying version history table ---------
2026-08-11 02:34:14,384 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 02:34:14,651 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 02:34:14,652 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 02:34:14,918 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 02:34:14,918 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 02:34:14,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 02:34:15.176 UTC [6091] WARNING: there is no transaction in progress
2026-08-11 02:34:15,183 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 02:34:15,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 02:34:15,458 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 02:34:15,459 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 02:34:15,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 02:34:15,722 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 02:34:15,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7nm7.c.gcp-upstream.internal','N') ;"
2026-08-11 02:34:16,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 02:34:16,518 [I] Table x_portal_user does not exist in database ranger
2026-08-11 02:34:16,519 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 02:34:16,794 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 02:34:16,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 02:34:17,038 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 02:34:17,295 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 02:34:17,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 02:34:18.370 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.387 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.405 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.421 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.438 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.457 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.522 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.532 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.549 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.560 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.572 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.587 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.597 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.604 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.610 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:18.616 UTC [6271] WARNING: there is no transaction in progress
2026-08-11 02:34:19,306 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 02:34:19,307 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 02:34:19,562 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 02:34:19,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 02:34:19,828 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 02:34:19,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 02:34:20,075 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 02:34:20,075 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 02:34:20,314 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 02:34:20,578 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7nm7.c.gcp-upstream.internal';"
2026-08-11 02:34:20,827 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 02:34:20,827 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 02:34:21,083 [I] DB_PATCHES have already been applied
I20260811 02:34:21.090147 17724 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-admin:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskyYEYPK/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 02:34:21.090374 17724 mini_ranger.cc:193] Using host: 127.17.79.20
I20260811 02:34:21.094534 17724 mini_ranger.cc:227] Ranger admin URL: http://127.17.79.20:42391
Aug 11, 2026 2:34:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:34:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:34:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 2:34:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 2:34:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 2:34:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 2:34:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 02:34:22.532519 17724 mini_ranger.cc:160] Time spent starting Ranger: real 9.218s user 0.000s sys 0.012s
Aug 11, 2026 2:34:42 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 2:34:42 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 2:34:42 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 2:34:42 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 2:34:43 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 02:34:43.804605 17724 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.79.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.79.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/rangerkms_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.79.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/rangerkms_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.79.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.79.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.79.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/HTTP_127.17.79.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 02:34:43 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415683, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 02:34:43.889943 17724 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 02:34:43.898857 17724 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 02:34:44.747983 17724 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 02:34:44.748077 17724 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms
I20260811 02:34:44.748101 17724 mini_ranger_kms.cc:227] Using postgres at 127.17.79.20:40995
2026-08-11 02:34:44,930 [I] DB FLAVOR :POSTGRES
2026-08-11 02:34:44,930 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 02:34:44,930 [I] Checking connection
2026-08-11 02:34:44,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 02:34:45,196 [I] connection success
2026-08-11 02:34:45,196 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 02:34:45,197 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 02:34:45,197 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 02:34:45,437 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 02:34:45,437 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 02:34:45,438 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 02:34:45,438 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.79.20:40995/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 02:34:45,728 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 02:34:46.184068 17724 mini_ranger_kms.cc:310] Created kms service
I20260811 02:34:46.359547 17724 mini_ranger_kms.cc:326] Created kudu user
I20260811 02:34:46.404584 17724 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 02:34:46 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415683, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:46.810367 17724 mini_ranger_kms.cc:384] Added ranger policy
I20260811 02:34:46.810621 17724 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms:/tmp/dist-test-taskyYEYPK/build/release/bin/postgresql.jar:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskyYEYPK/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 02:34:46.810649 17724 mini_ranger_kms.cc:240] Using host: 127.17.79.20
I20260811 02:34:46.815338 17724 mini_ranger_kms.cc:276] Ranger KMS PID: 6616
I20260811 02:34:46.815421 17724 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.79.20:52081
Aug 11, 2026 2:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 2:34:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 2:34:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 2:34:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 2:34:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 2:34:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 02:34:49 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786415689, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.79.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 02:34:49 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415689, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.79.20@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:49.761665 17724 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.872s user 0.015s sys 0.149s
I20260811 02:34:49.761765 17724 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 02:34:49.761811 17724 mini_ranger_kms.cc:401] 127.17.79.20:52081/kms/v1/keys
Aug 11 02:34:49 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415689, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.79.20@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
Aug 11 02:34:52 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:34:52.483246 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46477
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:46477
--ranger_config_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:52.585150 6719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:52.585367 6719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:52.585390 6719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:52.586581 6719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:34:52.586625 6719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:52.586639 6719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:52.586651 6719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:34:52.586705 6719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:34:52.588320 6719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.79.20:52081/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:46477
--ranger_config_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:52.588557 6719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:52.588809 6719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:52.595261 6729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:52.595387 6726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:52.595427 6719 server_base.cc:1034] running on GCE node
W20260811 02:34:52.595261 6732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:52.595760 6719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:52.596119 6719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:52.597307 6719 hybrid_clock.cc:648] HybridClock initialized: now 1786415692597291 us; error 49 us; skew 500 ppm
Aug 11 02:34:52 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415692, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:52.604609 6719 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:34:52.605160 6719 webserver.cc:460] Webserver started at http://127.17.79.62:33931/ using document root <none> and password file <none>
I20260811 02:34:52.605427 6719 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:52.605487 6719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:52.605646 6719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:52 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415692, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:52.652642 6719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "f9daf47598f445c0a2f7a30802c22215"
format_stamp: "Formatted at 2026-08-11 02:34:52 on dist-test-slave-7nm7"
server_key: "14f683905fb36fcd1bc1383679bc5a39"
server_key_iv: "8c4f74c3a1e0eb9f7d61af23a4e07466"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:52.653090 6719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "f9daf47598f445c0a2f7a30802c22215"
format_stamp: "Formatted at 2026-08-11 02:34:52 on dist-test-slave-7nm7"
server_key: "14f683905fb36fcd1bc1383679bc5a39"
server_key_iv: "8c4f74c3a1e0eb9f7d61af23a4e07466"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:52.654619 6719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:34:52.666181 6747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:52.666453 6719 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:52.666563 6719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "f9daf47598f445c0a2f7a30802c22215"
format_stamp: "Formatted at 2026-08-11 02:34:52 on dist-test-slave-7nm7"
server_key: "14f683905fb36fcd1bc1383679bc5a39"
server_key_iv: "8c4f74c3a1e0eb9f7d61af23a4e07466"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:52.666672 6719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:52.688349 6719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:52.690574 6719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:52.690757 6719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:52.695813 6719 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:46477
I20260811 02:34:52.695842 6850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:46477 every 8 connection(s)
I20260811 02:34:52.696238 6719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:34:52.696945 6853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:52.699470 6853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Bootstrap starting.
I20260811 02:34:52.700099 6853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:52.700417 6853 log.cc:824] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:52.700896 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 6719
I20260811 02:34:52.701004 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:34:52.701198 6853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: No bootstrap required, opened a new log
I20260811 02:34:52.701200 17724 external_mini_cluster.cc:1428] Setting key 3edca9ba759945e731eb121c53967013
I20260811 02:34:52.704263 6853 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:52.704424 6853 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:52.704488 6853 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9daf47598f445c0a2f7a30802c22215, State: Initialized, Role: FOLLOWER
I20260811 02:34:52.704653 6853 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:52.704778 6853 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:34:52.704835 6853 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:34:52.704908 6853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:52.705538 6853 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:52.705648 6853 leader_election.cc:302] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9daf47598f445c0a2f7a30802c22215; no voters:
I20260811 02:34:52.705830 6853 leader_election.cc:288] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:34:52.705874 6861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:34:52.706142 6861 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 LEADER]: Becoming Leader. State: Replica: f9daf47598f445c0a2f7a30802c22215, State: Running, Role: LEADER
I20260811 02:34:52.706321 6861 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:52.706319 6853 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:34:52.706784 6861 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9daf47598f445c0a2f7a30802c22215. Latest consensus state: current_term: 1 leader_uuid: "f9daf47598f445c0a2f7a30802c22215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } } }
I20260811 02:34:52.706899 6861 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:52.706954 6863 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9daf47598f445c0a2f7a30802c22215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } } }
I20260811 02:34:52.707120 6863 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:52.708532 6853 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 02:34:52.709007 6873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 02:34:52 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:52.712262 6873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:34:52.716043 6873 catalog_manager.cc:1347] Generated new cluster ID: e2348da177df484d83d7f69a00d1fdd3
I20260811 02:34:52.716138 6873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:34:52.717072 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:52.701800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34896 (local address 127.17.79.62:46477)
0811 02:34:52.701995 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:52.702005 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:52.702038 (+ 33us) server_negotiation.cc:407] Connection header received
0811 02:34:52.702806 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:52.702816 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:52.702884 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:52.703044 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:52.703926 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:52.705371 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:52.706616 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:52.707292 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:52.707382 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:52.711113 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:52.711175 (+ 62us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:52.711176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:52.711272 (+ 96us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:52.714501 (+ 3229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:52.714944 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:52.714947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:52.714948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:52.715060 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:52.715290 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:52.715291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:52.715291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:52.715757 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:52.715956 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:52.716417 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 02:34:52.716776 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":75,"threads_started":1}
I20260811 02:34:52.727360 6873 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:34:52.728179 6873 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:34:52.736011 6873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Generated new TSK 0
I20260811 02:34:52.736261 6873 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:34:53.521274 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46477
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:53.613396 6927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:53.613705 6927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:53.613750 6927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:53.615455 6927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:53.615543 6927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:53.615594 6927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:34:53.617501 6927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.79.20:52081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:53.617816 6927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:53.618081 6927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:53.623383 6935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:53.623373 6936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:53.623392 6941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:53.624249 6927 server_base.cc:1034] running on GCE node
I20260811 02:34:53.624498 6927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:53.624799 6927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:53.625976 6927 hybrid_clock.cc:648] HybridClock initialized: now 1786415693625965 us; error 31 us; skew 500 ppm
Aug 11 02:34:53 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:53.629166 6927 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:34:53.629664 6927 webserver.cc:460] Webserver started at http://127.17.79.1:33719/ using document root <none> and password file <none>
I20260811 02:34:53.629920 6927 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:53.629992 6927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:53.630141 6927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:53 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:53.645053 6927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "0d61ca632eeb4da09aabfb245c1b12d6"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "248d72889bf9a6495b9b812797f87855"
server_key_iv: "49f72ecfe02188f9b7ab9a703075eead"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:53.645529 6927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "0d61ca632eeb4da09aabfb245c1b12d6"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "248d72889bf9a6495b9b812797f87855"
server_key_iv: "49f72ecfe02188f9b7ab9a703075eead"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:53.647596 6927 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 02:34:53.665845 6950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:53.666114 6927 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 02:34:53.666258 6927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "0d61ca632eeb4da09aabfb245c1b12d6"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "248d72889bf9a6495b9b812797f87855"
server_key_iv: "49f72ecfe02188f9b7ab9a703075eead"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:53.666393 6927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:53.677878 6927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:53.680493 6927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:53.680698 6927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:53.680961 6927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:53.681337 6927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:53.681403 6927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:53.681453 6927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:53.681489 6927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:53.691606 6927 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:44679
I20260811 02:34:53.692006 6927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:34:53.692589 7145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:44679 every 8 connection(s)
Aug 11 02:34:53 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:53.699116 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 6927
I20260811 02:34:53.699224 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:34:53.699429 17724 external_mini_cluster.cc:1428] Setting key 0ea758a2b1d38c6371b1ab0dbdd2527f
I20260811 02:34:53.704704 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:53.692927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:55387 (local address 127.17.79.62:46477)
0811 02:34:53.693769 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:53.693771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:53.693779 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:34:53.693801 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:53.693802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:53.693812 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:53.693902 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:53.694590 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.695119 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.696453 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.696755 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.696817 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:53.699485 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:53.699488 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:53.699488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:53.699497 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:53.701556 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:53.702086 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:53.702087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:53.702087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:53.702155 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:53.702499 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:53.702500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:53.702500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:53.702642 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:53.702728 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:53.704457 (+ 1729us) server_negotiation.cc:299] Negotiation successful
0811 02:34:53.704566 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":814,"thread_start_us":88,"threads_started":1}
I20260811 02:34:53.705417 7155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:53.692920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46477 (local address 127.17.79.1:55387)
0811 02:34:53.693091 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:53.693134 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:53.693615 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:53.693985 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:53.693989 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:53.694200 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:53.694483 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:53.694488 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.695229 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.695230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:53.696352 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:53.696355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.696902 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.696904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:53.697053 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:53.697687 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:53.697698 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:53.699360 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:53.701649 (+ 2289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:53.701657 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:53.701660 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:53.701999 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:53.702223 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:53.702224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:53.702224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:53.702416 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:53.702733 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:53.702741 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:53.704278 (+ 1537us) client_negotiation.cc:769] Sending connection context
0811 02:34:53.704925 (+ 647us) client_negotiation.cc:240] Negotiation successful
0811 02:34:53.705117 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260811 02:34:53.710485 7148 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46477
I20260811 02:34:53.710669 7148 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:53.710933 7148 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:53.711618 6787 ts_manager.cc:194] Registered new tserver with Master: 0d61ca632eeb4da09aabfb245c1b12d6 (127.17.79.1:44679)
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
I20260811 02:34:53.712563 6787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:55387
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:34:53.734982 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46477
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:53.857559 7165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:53.857919 7165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:53.858008 7165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:53.859823 7165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:53.859941 7165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:53.860033 7165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:34:53.862319 7165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.79.20:52081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:53.862799 7165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:53.863127 7165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:53.870409 7175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:53.870831 7174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:53.871239 7180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:53.872619 7165 server_base.cc:1034] running on GCE node
I20260811 02:34:53.872954 7165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:53.873234 7165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:53.874375 7165 hybrid_clock.cc:648] HybridClock initialized: now 1786415693874336 us; error 53 us; skew 500 ppm
Aug 11 02:34:53 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:53.877782 7165 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:34:53.878466 7165 webserver.cc:460] Webserver started at http://127.17.79.2:39975/ using document root <none> and password file <none>
I20260811 02:34:53.878731 7165 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:53.878784 7165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:53.878906 7165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:53 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:53.895632 7165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "2f6cbfb162164e7fa4639f88cca7d9d3"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "d6f35bf1068810237e19809efecc0d64"
server_key_iv: "0e1b7488a497377c9fbe1e3c9b18122d"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:53.896133 7165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "2f6cbfb162164e7fa4639f88cca7d9d3"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "d6f35bf1068810237e19809efecc0d64"
server_key_iv: "0e1b7488a497377c9fbe1e3c9b18122d"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:53.905249 7165 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.000s sys 0.002s
I20260811 02:34:53.931209 7194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:53.931491 7165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 02:34:53.931587 7165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "2f6cbfb162164e7fa4639f88cca7d9d3"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "d6f35bf1068810237e19809efecc0d64"
server_key_iv: "0e1b7488a497377c9fbe1e3c9b18122d"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:53.931676 7165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 11 02:34:53 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786415693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:53.950434 7165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:53.952764 7165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:53.952961 7165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:53.953223 7165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:53.953647 7165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:53.953742 7165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:53.953814 7165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:53.953873 7165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:53.961938 7165 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:37919
I20260811 02:34:53.962833 7165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:34:53.964900 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 7165
I20260811 02:34:53.965008 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:34:53.965246 17724 external_mini_cluster.cc:1428] Setting key fcd971db2ca23a095433aab4d4e6274e
I20260811 02:34:53.965519 7413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:37919 every 8 connection(s)
Aug 11 02:34:53 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415693, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
I20260811 02:34:53.987560 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:53.966544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:57011 (local address 127.17.79.62:46477)
0811 02:34:53.966599 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:53.966601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:53.966942 (+ 341us) server_negotiation.cc:407] Connection header received
0811 02:34:53.967634 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:53.967635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:53.967657 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:53.967688 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:53.968510 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.969296 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.972989 (+ 3693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.973301 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.973343 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:53.980018 (+ 6675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:53.980020 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:53.980021 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:53.980030 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:53.985745 (+ 5715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:53.986351 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:53.986353 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:53.986353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:53.986419 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:53.986717 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:53.986718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:53.986719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:53.986866 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:53.986923 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:53.987351 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 02:34:53.987453 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 02:34:53.988085 7417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:53.966132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46477 (local address 127.17.79.2:57011)
0811 02:34:53.966812 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:53.966858 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:53.967513 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:53.967871 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:53.967875 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:53.968120 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:53.968402 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:53.968407 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.969486 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.969486 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:53.972877 (+ 3391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:53.972880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:53.973501 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:53.973502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:53.973690 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:53.974529 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:53.974541 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:53.979880 (+ 5339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:53.985871 (+ 5991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:53.985882 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:53.985885 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:53.986251 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:53.986491 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:53.986492 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:53.986492 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:53.986637 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:53.986960 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:53.986967 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:53.987168 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 02:34:53.987663 (+ 495us) client_negotiation.cc:240] Negotiation successful
0811 02:34:53.987844 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":203,"threads_started":1}
I20260811 02:34:53.988840 7415 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46477
I20260811 02:34:53.988940 7415 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:53.989202 7415 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:53.989617 6787 ts_manager.cc:194] Registered new tserver with Master: 2f6cbfb162164e7fa4639f88cca7d9d3 (127.17.79.2:37919)
I20260811 02:34:53.990118 6787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:57011
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:34:54.016793 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46477
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:54.202510 7421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:54.202812 7421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:54.202853 7421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:54.204569 7421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:54.204638 7421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:54.204697 7421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:34:54.207103 7421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.79.20:52081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:46477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:54.207367 7421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:54.207633 7421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:54.215485 7430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.215830 7429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.216061 7435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:54.227903 7421 server_base.cc:1034] running on GCE node
I20260811 02:34:54.228331 7421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:54.228780 7421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:54.232170 7421 hybrid_clock.cc:648] HybridClock initialized: now 1786415694232148 us; error 51 us; skew 500 ppm
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:54.236389 7421 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:34:54.236999 7421 webserver.cc:460] Webserver started at http://127.17.79.3:45289/ using document root <none> and password file <none>
I20260811 02:34:54.237349 7421 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:54.237425 7421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:54.237574 7421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:54.254333 7421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "08d3b3925a5f4f3a8636fce95cd1cd78"
format_stamp: "Formatted at 2026-08-11 02:34:54 on dist-test-slave-7nm7"
server_key: "490bf06e924c66509ed7e113dd5a170b"
server_key_iv: "43d77e89d1da6b8864d1750d2f098e50"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:54.255012 7421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "08d3b3925a5f4f3a8636fce95cd1cd78"
format_stamp: "Formatted at 2026-08-11 02:34:54 on dist-test-slave-7nm7"
server_key: "490bf06e924c66509ed7e113dd5a170b"
server_key_iv: "43d77e89d1da6b8864d1750d2f098e50"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:54.258261 7421 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 02:34:54.273198 7443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.273419 7421 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:54.273525 7421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "08d3b3925a5f4f3a8636fce95cd1cd78"
format_stamp: "Formatted at 2026-08-11 02:34:54 on dist-test-slave-7nm7"
server_key: "490bf06e924c66509ed7e113dd5a170b"
server_key_iv: "43d77e89d1da6b8864d1750d2f098e50"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:54.273639 7421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:54.291378 7421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:54.293573 7421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:54.293742 7421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:54.294063 7421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:54.294509 7421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:54.294566 7421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.294607 7421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:54.294632 7421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.307384 7421 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:33363
I20260811 02:34:54.307716 7639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:33363 every 8 connection(s)
I20260811 02:34:54.308001 7421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:34:54.315549 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 7421
I20260811 02:34:54.315666 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:34:54.315877 17724 external_mini_cluster.cc:1428] Setting key 6321da44b8664c7ab4fdcb39f7703d21
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:54.323858 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:54.309182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:44741 (local address 127.17.79.62:46477)
0811 02:34:54.309227 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:54.309229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:54.309428 (+ 199us) server_negotiation.cc:407] Connection header received
0811 02:34:54.310098 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:54.310100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:54.310114 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:54.310146 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:54.311128 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.311955 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.313495 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.313713 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.313813 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:54.320284 (+ 6471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:54.320286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:54.320286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:54.320293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:54.321995 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:54.322568 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:54.322569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:54.322570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:54.322634 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:54.322994 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:54.322995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:54.322995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:54.323140 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:54.323208 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:54.323651 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 02:34:54.323757 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:34:54.324390 7642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:54.308891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46477 (local address 127.17.79.3:44741)
0811 02:34:54.309297 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:54.309342 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:54.309971 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:54.310383 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:54.310387 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:54.310743 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:54.311014 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:54.311020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.312075 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.312075 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:54.313405 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:54.313408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.313839 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.313840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:54.313977 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:54.318398 (+ 4421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:54.318421 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:54.320188 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:54.322098 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:54.322106 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:54.322109 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:54.322475 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:54.322741 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:54.322742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:54.322743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:54.322893 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:54.323241 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:54.323249 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:54.323476 (+ 227us) client_negotiation.cc:769] Sending connection context
0811 02:34:54.323993 (+ 517us) client_negotiation.cc:240] Negotiation successful
0811 02:34:54.324157 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":88,"threads_started":1}
I20260811 02:34:54.324838 7640 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46477
I20260811 02:34:54.324941 7640 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:54.325135 7640 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:54.325495 6787 ts_manager.cc:194] Registered new tserver with Master: 08d3b3925a5f4f3a8636fce95cd1cd78 (127.17.79.3:33363)
I20260811 02:34:54.326004 6787 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:44741
I20260811 02:34:54.327756 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:34:54.328548 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 6927
I20260811 02:34:54.338932 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 7165
I20260811 02:34:54.356655 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 7421
I20260811 02:34:54.377787 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 6719
I20260811 02:34:54.393944 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46477
--webserver_interface=127.17.79.62
--webserver_port=33931
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:46477
--ranger_config_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:54.478127 7644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:54.478351 7644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:54.478374 7644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:54.479507 7644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:34:54.479552 7644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:54.479566 7644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:54.479578 7644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:34:54.479590 7644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:34:54.481199 7644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:46477
--ranger_config_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=33931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:54.481382 7644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:54.481539 7644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:34:54.486433 7644 server_base.cc:1034] running on GCE node
W20260811 02:34:54.486423 7654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.486555 7658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.486423 7656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:54.486796 7644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:54.487105 7644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:54.488279 7644 hybrid_clock.cc:648] HybridClock initialized: now 1786415694488266 us; error 26 us; skew 500 ppm
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:54.490700 7644 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:34:54.491119 7644 webserver.cc:460] Webserver started at http://127.17.79.62:33931/ using document root <none> and password file <none>
I20260811 02:34:54.491331 7644 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:54.491405 7644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:54.567739 7644 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:54.568565 7676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.568776 7644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:54.568895 7644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "f9daf47598f445c0a2f7a30802c22215"
format_stamp: "Formatted at 2026-08-11 02:34:52 on dist-test-slave-7nm7"
server_key: "14f683905fb36fcd1bc1383679bc5a39"
server_key_iv: "8c4f74c3a1e0eb9f7d61af23a4e07466"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:54.569309 7644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:54.581640 7644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:54.583750 7644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:54.583925 7644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:54.588224 7644 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:46477
I20260811 02:34:54.588305 7791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:46477 every 8 connection(s)
I20260811 02:34:54.588685 7644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:34:54.589978 7792 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:34:54.590621 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 7644
I20260811 02:34:54.590807 7792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Bootstrap starting.
I20260811 02:34:54.590935 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:44679
--local_ip_for_outbound_sockets=127.17.79.1
--tserver_master_addrs=127.17.79.62:46477
--webserver_port=33719
--webserver_interface=127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:34:54.600720 7792 log.cc:824] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:54.602811 7792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:34:54.603133 7792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Bootstrap complete.
I20260811 02:34:54.605722 7792 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:54.606014 7792 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9daf47598f445c0a2f7a30802c22215, State: Initialized, Role: FOLLOWER
I20260811 02:34:54.606208 7792 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:54.606338 7792 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:34:54.606396 7792 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:34:54.606446 7792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 1 FOLLOWER]: Advancing to term 2
I20260811 02:34:54.607445 7792 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:54.607571 7792 leader_election.cc:302] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9daf47598f445c0a2f7a30802c22215; no voters:
I20260811 02:34:54.607780 7792 leader_election.cc:288] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 02:34:54.607817 7801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 02:34:54.607928 7801 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [term 2 LEADER]: Becoming Leader. State: Replica: f9daf47598f445c0a2f7a30802c22215, State: Running, Role: LEADER
I20260811 02:34:54.608084 7801 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } }
I20260811 02:34:54.608088 7792 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:34:54.608433 7802 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f9daf47598f445c0a2f7a30802c22215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } } }
I20260811 02:34:54.608520 7802 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:54.608749 7803 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9daf47598f445c0a2f7a30802c22215. Latest consensus state: current_term: 2 leader_uuid: "f9daf47598f445c0a2f7a30802c22215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9daf47598f445c0a2f7a30802c22215" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46477 } } }
I20260811 02:34:54.608848 7803 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:54.608867 7807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:34:54.609427 7807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:34:54.609629 7807 catalog_manager.cc:1259] Loaded cluster ID: e2348da177df484d83d7f69a00d1fdd3
I20260811 02:34:54.609735 7807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:34:54.609764 7792 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 02:34:54.614288 7807 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:34:54.614976 7807 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Loaded TSK: 0
I20260811 02:34:54.615258 7807 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 02:34:54.703922 7794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:54.704195 7794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:54.704246 7794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:54.705925 7794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:54.705987 7794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:54.706027 7794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:34:54.708200 7794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:44679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=33719
--tserver_master_addrs=127.17.79.62:46477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:54.708587 7794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:54.708858 7794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:54.715387 7855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.715413 7852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.715652 7853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:54.715982 7794 server_base.cc:1034] running on GCE node
I20260811 02:34:54.716292 7794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:54.716583 7794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:54.717741 7794 hybrid_clock.cc:648] HybridClock initialized: now 1786415694717717 us; error 35 us; skew 500 ppm
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:54.721344 7794 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:34:54.721889 7794 webserver.cc:460] Webserver started at http://127.17.79.1:33719/ using document root <none> and password file <none>
I20260811 02:34:54.722215 7794 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:54.722410 7794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:54.743896 7794 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260811 02:34:54.744728 7867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.744957 7794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:34:54.745049 7794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "0d61ca632eeb4da09aabfb245c1b12d6"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "248d72889bf9a6495b9b812797f87855"
server_key_iv: "49f72ecfe02188f9b7ab9a703075eead"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:54.745530 7794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:54.764213 7794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:54.766782 7794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:54.767005 7794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:54.767297 7794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:54.767719 7794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:54.767803 7794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.767870 7794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:54.767920 7794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.775328 7794 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:44679
I20260811 02:34:54.775857 7794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:34:54.777631 8056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:44679 every 8 connection(s)
I20260811 02:34:54.778486 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 7794
I20260811 02:34:54.778781 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:37919
--local_ip_for_outbound_sockets=127.17.79.2
--tserver_master_addrs=127.17.79.62:46477
--webserver_port=39975
--webserver_interface=127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:54.809154 8064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:54.782944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46477 (local address 127.17.79.1:53187)
0811 02:34:54.783143 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:54.783187 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:54.783803 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:54.796320 (+ 12517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:54.796325 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:54.796609 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:54.796898 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:54.796905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.798637 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.798638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:54.799927 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:54.799930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.800889 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.800890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:54.801025 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:54.801681 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:54.801692 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:54.803457 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:54.805784 (+ 2327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:54.805792 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:54.805794 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:54.806079 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:54.806559 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:54.806559 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:54.806560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:54.806686 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:54.808281 (+ 1595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:54.808288 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:54.808504 (+ 216us) client_negotiation.cc:769] Sending connection context
0811 02:34:54.808649 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 02:34:54.808823 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":119,"threads_started":1}
I20260811 02:34:54.809651 8065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:54.783010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:53187 (local address 127.17.79.62:46477)
0811 02:34:54.795602 (+ 12592us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:54.795616 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:54.795672 (+ 56us) server_negotiation.cc:407] Connection header received
0811 02:34:54.795848 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:54.795856 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:54.795926 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:54.796112 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:54.797050 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.798506 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.800032 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.800669 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.800776 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:54.803582 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:54.803586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:54.803587 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:54.803599 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:54.805680 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:54.806352 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:54.806356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:54.806356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:54.806471 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:54.807786 (+ 1315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:54.807787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:54.807787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:54.808101 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:54.808238 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:54.808921 (+ 683us) server_negotiation.cc:299] Negotiation successful
0811 02:34:54.809459 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12512,"thread_start_us":94,"threads_started":1}
I20260811 02:34:54.810889 8058 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46477
I20260811 02:34:54.810992 8058 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:54.811185 8058 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
W20260811 02:34:54.812147 8058 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:46477 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 02:34:54.812222 8058 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:54.812290 8058 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:54.812685 8058 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:54.812774 8058 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
W20260811 02:34:54.813122 8058 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 02:34:54.919157 8063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:54.919468 8063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:54.919512 8063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:54.921182 8063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:54.921245 8063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:54.921291 8063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:34:54.923511 8063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:37919
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=39975
--tserver_master_addrs=127.17.79.62:46477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:54.923763 8063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:54.924052 8063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:54.929724 8079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.929839 8078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:54.929728 8082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:54.930384 8063 server_base.cc:1034] running on GCE node
I20260811 02:34:54.930624 8063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:54.930887 8063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:54.932050 8063 hybrid_clock.cc:648] HybridClock initialized: now 1786415694932040 us; error 27 us; skew 500 ppm
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:54.934793 8063 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:34:54.935271 8063 webserver.cc:460] Webserver started at http://127.17.79.2:39975/ using document root <none> and password file <none>
I20260811 02:34:54.935504 8063 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:54.935590 8063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:54.952491 8063 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:54.953315 8102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.953531 8063 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:54.953691 8063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "2f6cbfb162164e7fa4639f88cca7d9d3"
format_stamp: "Formatted at 2026-08-11 02:34:53 on dist-test-slave-7nm7"
server_key: "d6f35bf1068810237e19809efecc0d64"
server_key_iv: "0e1b7488a497377c9fbe1e3c9b18122d"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:54.954301 8063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:54.976897 8063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:54.979415 8063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:54.979606 8063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:54.979904 8063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:54.980278 8063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:54.980325 8063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.980357 8063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:54.980376 8063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:54.988364 8063 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:37919
I20260811 02:34:54.988838 8063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:34:54.989485 8270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:37919 every 8 connection(s)
Aug 11 02:34:54 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415694, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:54.999023 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 8063
I20260811 02:34:54.999382 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.79.20:52081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:33363
--local_ip_for_outbound_sockets=127.17.79.3
--tserver_master_addrs=127.17.79.62:46477
--webserver_port=45289
--webserver_interface=127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:43733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:34:55.000113 8065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:54.989919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:47781 (local address 127.17.79.62:46477)
0811 02:34:54.989984 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:54.989986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:54.990000 (+ 14us) server_negotiation.cc:407] Connection header received
0811 02:34:54.990599 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:54.990601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:54.990615 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:54.990709 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:54.991436 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.992216 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.993609 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.993919 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.994000 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:54.996551 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:54.996553 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:54.996554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:54.996562 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:54.998309 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:54.998713 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:54.998714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:54.998715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:54.998782 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:54.999147 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:54.999149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:54.999149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:54.999389 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:54.999494 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:54.999917 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 02:34:55.000012 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 02:34:55.000676 8274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:54.989654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46477 (local address 127.17.79.2:47781)
0811 02:34:54.989853 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:54.989900 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:54.990470 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:54.990765 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:54.990768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:54.991036 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:54.991314 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:54.991320 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.992327 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.992328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:54.993501 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:54.993505 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:54.994037 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:54.994039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:54.994175 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:54.994820 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:54.994831 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:54.996447 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:54.998386 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:54.998393 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:54.998395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:54.998615 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:54.998866 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:54.998867 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:54.998867 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:54.999041 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:54.999527 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:54.999535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:54.999745 (+ 210us) client_negotiation.cc:769] Sending connection context
0811 02:34:55.000271 (+ 526us) client_negotiation.cc:240] Negotiation successful
0811 02:34:55.000441 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":79,"threads_started":1}
I20260811 02:34:55.001204 8271 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46477
I20260811 02:34:55.001295 8271 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:55.001487 8271 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
W20260811 02:34:55.002252 8271 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:46477 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 02:34:55.002372 8271 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:55.002457 8271 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:55.002823 8271 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:55.002923 8271 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
W20260811 02:34:55.003203 8271 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 02:34:55.128789 8276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:55.129158 8276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:55.129266 8276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:55.131145 8276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:55.131266 8276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:55.131349 8276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:34:55.133606 8276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:43733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.79.20:52081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:33363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=45289
--tserver_master_addrs=127.17.79.62:46477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:55.134012 8276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:55.134349 8276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:55.141248 8289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:55.141466 8276 server_base.cc:1034] running on GCE node
W20260811 02:34:55.141726 8288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:55.143132 8291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:55.143466 8276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:55.143783 8276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:55.144964 8276 hybrid_clock.cc:648] HybridClock initialized: now 1786415695144938 us; error 40 us; skew 500 ppm
Aug 11 02:34:55 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:55.148471 8276 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:34:55.149080 8276 webserver.cc:460] Webserver started at http://127.17.79.3:45289/ using document root <none> and password file <none>
I20260811 02:34:55.149453 8276 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:55.149602 8276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 02:34:55 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:55.170014 8276 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 02:34:55.171247 8304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:55.171447 8276 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:34:55.171566 8276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "08d3b3925a5f4f3a8636fce95cd1cd78"
format_stamp: "Formatted at 2026-08-11 02:34:54 on dist-test-slave-7nm7"
server_key: "490bf06e924c66509ed7e113dd5a170b"
server_key_iv: "43d77e89d1da6b8864d1750d2f098e50"
server_key_version: "kuduclusterkey@0"
I20260811 02:34:55.172039 8276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:55.208813 8276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:55.211246 8276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:55.211406 8276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:55.211637 8276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:34:55.211994 8276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:34:55.212044 8276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:55.212076 8276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:34:55.212103 8276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:55.220172 8276 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:33363
I20260811 02:34:55.220268 8497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:33363 every 8 connection(s)
I20260811 02:34:55.220677 8276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:34:55.227759 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 8276
Aug 11 02:34:55 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:55.232266 8500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:55.221469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:46477 (local address 127.17.79.3:53821)
0811 02:34:55.221643 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:55.221692 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:55.222418 (+ 726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:55.222679 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:55.222684 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:55.222936 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:55.223214 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:55.223221 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:55.224218 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:55.224219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:55.225502 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:55.225505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:55.226080 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:55.226081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:55.226221 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:55.226849 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:55.226858 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:55.228657 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:55.230738 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:55.230744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:55.230746 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:55.230960 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:55.231201 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:55.231202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:55.231203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:55.231324 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:55.231586 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:55.231593 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:55.231771 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 02:34:55.231884 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 02:34:55.232029 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260811 02:34:55.232887 8065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:55.221471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:53821 (local address 127.17.79.62:46477)
0811 02:34:55.221553 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:55.221555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:55.221794 (+ 239us) server_negotiation.cc:407] Connection header received
0811 02:34:55.222522 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:55.222524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:55.222536 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:55.222607 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:55.223352 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:55.224090 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:55.225617 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:55.225911 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:55.225967 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:55.228755 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:55.228756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:55.228757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:55.228763 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:55.230650 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:55.231066 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:55.231067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:55.231068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:55.231131 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:55.231399 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:55.231400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:55.231400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:55.231517 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:55.231594 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:55.232757 (+ 1163us) server_negotiation.cc:299] Negotiation successful
0811 02:34:55.232828 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 02:34:55.233275 8498 heartbeater.cc:347] Connected to a master server at 127.17.79.62:46477
I20260811 02:34:55.233393 8498 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:55.233572 8498 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
W20260811 02:34:55.234274 8498 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:46477 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 02:34:55.234344 8498 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:55.234418 8498 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:55.234737 8498 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:55.234814 8498 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
W20260811 02:34:55.235100 8498 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 02:34:55.239447 8503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:55.228415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.17.79.62:46477)
0811 02:34:55.228979 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:55.228981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:55.228989 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:34:55.229010 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:55.229010 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:55.229023 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:55.229101 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:55.230762 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:55.231513 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:55.234865 (+ 3352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:55.235187 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:55.235275 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:55.236624 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:55.236625 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:55.236626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:55.236633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:55.238339 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:55.238662 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:55.238663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:55.238663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:55.238728 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:55.238919 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:55.238920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:55.238920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:55.239054 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:55.239226 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:55.239265 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 02:34:55.239351 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":57,"threads_started":1}
Aug 11 02:34:55 dist-test-slave-7nm7 krb5kdc[5899](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786415695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:55.813370 8058 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:55.813545 8058 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:55.814024 7715 ts_manager.cc:194] Registered new tserver with Master: 0d61ca632eeb4da09aabfb245c1b12d6 (127.17.79.1:44679)
I20260811 02:34:55.815088 7715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:53187
I20260811 02:34:56.003412 8271 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:56.003583 8271 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:56.003883 7715 ts_manager.cc:194] Registered new tserver with Master: 2f6cbfb162164e7fa4639f88cca7d9d3 (127.17.79.2:37919)
I20260811 02:34:56.004429 7715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:47781
Aug 11 02:34:56 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:56.235308 8498 heartbeater.cc:464] Registering TS with master...
I20260811 02:34:56.235496 8498 heartbeater.cc:511] Master 127.17.79.62:46477 requested a full tablet report, sending...
I20260811 02:34:56.235899 7715 ts_manager.cc:194] Registered new tserver with Master: 08d3b3925a5f4f3a8636fce95cd1cd78 (127.17.79.3:33363)
I20260811 02:34:56.236320 7715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:53821
I20260811 02:34:56.238266 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:34:56.249311 8534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.239307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33620 (local address 127.17.79.62:46477)
0811 02:34:56.242576 (+ 3269us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:56.242578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:56.242587 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:34:56.242623 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:56.242624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:56.242634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:56.242733 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:56.243323 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.243899 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.244622 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.244850 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.244931 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.246190 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:56.246192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:56.246192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:56.246200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:56.247803 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:56.248456 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:56.248458 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:56.248458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:56.248522 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:56.248732 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:56.248733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:56.248734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:56.248860 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:56.248970 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:56.249092 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 02:34:56.249188 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3242,"thread_start_us":70,"threads_started":1}
I20260811 02:34:56.251567 7715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:34:56.253401 7715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:34:56.261543 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.257161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37919 (local address 127.0.0.1:42714)
0811 02:34:56.257989 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:56.258031 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:56.258137 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:56.258535 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:56.258538 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:56.258540 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:56.258613 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.258616 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.259591 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.259591 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.260514 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.260517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.261207 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.261208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.261293 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.261308 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 02:34:56.261408 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 02:34:56.261464 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":280,"threads_started":1}
I20260811 02:34:56.261549 8546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.257633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42714 (local address 127.17.79.2:37919)
0811 02:34:56.257787 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:56.257792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:56.258095 (+ 303us) server_negotiation.cc:407] Connection header received
0811 02:34:56.258318 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:56.258321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:56.258341 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:56.258400 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:56.258711 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.259466 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.260583 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.261093 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.261193 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.261275 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:56.261427 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 02:34:56.261468 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":96,"threads_started":1}
I20260811 02:34:56.262708 8178 tablet_service.cc:1467] Processing CreateTablet for tablet a3760d6107e2470ca28d8952c3b4dbf9 (DEFAULT_TABLE table=test-table [id=5c984fbfbf8e43aa8b2bb66836b03649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:34:56.263128 8178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3760d6107e2470ca28d8952c3b4dbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:56.270452 8550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.258293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33380 (local address 127.17.79.3:33363)
0811 02:34:56.266337 (+ 8044us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:56.266343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:56.266356 (+ 13us) server_negotiation.cc:407] Connection header received
0811 02:34:56.266393 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:56.266395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:56.266412 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:56.266519 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:56.266678 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.267806 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.269192 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.269906 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.269970 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.270040 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:56.270304 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 02:34:56.270354 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7999,"thread_start_us":87,"threads_started":1}
I20260811 02:34:56.270618 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.257161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:44679 (local address 127.0.0.1:37978)
0811 02:34:56.258683 (+ 1522us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:56.258694 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:56.258740 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:56.266576 (+ 7836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:56.266577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:56.266579 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:56.266629 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.266631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.267931 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.267931 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.269383 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.269385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.270343 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.270344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.270396 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.270400 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:34:56.270429 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 02:34:56.270473 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1484,"mutex_wait_us":731,"thread_start_us":80,"threads_started":1}
I20260811 02:34:56.270727 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.258043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:33363 (local address 127.0.0.1:33380)
0811 02:34:56.261939 (+ 3896us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:56.261951 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:56.261996 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:56.266524 (+ 4528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:56.266526 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:56.266527 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:56.266574 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.266575 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.267916 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.267917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.269060 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.269063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.270103 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.270104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.270175 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.270178 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:34:56.270580 (+ 402us) client_negotiation.cc:240] Negotiation successful
0811 02:34:56.270620 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3882,"mutex_wait_us":41,"thread_start_us":66,"threads_started":1}
I20260811 02:34:56.271253 8545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.257473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37978 (local address 127.17.79.1:44679)
0811 02:34:56.266385 (+ 8912us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:56.266389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:56.266400 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:34:56.266428 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:56.266430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:56.266442 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:56.266716 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:56.266798 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.267832 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.269476 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.270223 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.271012 (+ 789us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.271111 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:56.271139 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 02:34:56.271180 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8865,"thread_start_us":84,"threads_started":1}
I20260811 02:34:56.271618 8357 tablet_service.cc:1467] Processing CreateTablet for tablet a3760d6107e2470ca28d8952c3b4dbf9 (DEFAULT_TABLE table=test-table [id=5c984fbfbf8e43aa8b2bb66836b03649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:34:56.271855 7952 tablet_service.cc:1467] Processing CreateTablet for tablet a3760d6107e2470ca28d8952c3b4dbf9 (DEFAULT_TABLE table=test-table [id=5c984fbfbf8e43aa8b2bb66836b03649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:34:56.272008 8357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3760d6107e2470ca28d8952c3b4dbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:56.272233 7952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3760d6107e2470ca28d8952c3b4dbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:56.275647 8556 tablet_bootstrap.cc:492] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Bootstrap starting.
I20260811 02:34:56.276350 8556 tablet_bootstrap.cc:654] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:56.276711 8556 log.cc:824] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:56.277721 8556 tablet_bootstrap.cc:492] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: No bootstrap required, opened a new log
I20260811 02:34:56.277813 8556 ts_tablet_manager.cc:1397] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:34:56.278366 8553 tablet_bootstrap.cc:492] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: Bootstrap starting.
I20260811 02:34:56.279294 8553 tablet_bootstrap.cc:654] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:56.279631 8553 log.cc:824] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:56.280468 8556 raft_consensus.cc:348] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.280630 8556 raft_consensus.cc:374] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:56.280704 8556 raft_consensus.cc:729] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08d3b3925a5f4f3a8636fce95cd1cd78, State: Initialized, Role: FOLLOWER
I20260811 02:34:56.280840 8556 consensus_queue.cc:260] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.281143 8498 heartbeater.cc:503] Master 127.17.79.62:46477 was elected leader, sending a full tablet report...
I20260811 02:34:56.281430 8556 ts_tablet_manager.cc:1428] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260811 02:34:56.282727 8553 tablet_bootstrap.cc:492] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: No bootstrap required, opened a new log
I20260811 02:34:56.282819 8553 ts_tablet_manager.cc:1397] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 02:34:56.284768 8553 raft_consensus.cc:348] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.285005 8553 raft_consensus.cc:374] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:56.285087 8553 raft_consensus.cc:729] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6cbfb162164e7fa4639f88cca7d9d3, State: Initialized, Role: FOLLOWER
I20260811 02:34:56.285218 8553 consensus_queue.cc:260] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.285521 8271 heartbeater.cc:503] Master 127.17.79.62:46477 was elected leader, sending a full tablet report...
I20260811 02:34:56.285799 8553 ts_tablet_manager.cc:1428] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:34:56.286407 8555 tablet_bootstrap.cc:492] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6: Bootstrap starting.
I20260811 02:34:56.287171 8555 tablet_bootstrap.cc:654] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:56.287468 8555 log.cc:824] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:56.288254 8555 tablet_bootstrap.cc:492] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6: No bootstrap required, opened a new log
I20260811 02:34:56.288344 8555 ts_tablet_manager.cc:1397] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:34:56.290295 8555 raft_consensus.cc:348] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.290515 8555 raft_consensus.cc:374] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:56.290586 8555 raft_consensus.cc:729] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d61ca632eeb4da09aabfb245c1b12d6, State: Initialized, Role: FOLLOWER
I20260811 02:34:56.290740 8555 consensus_queue.cc:260] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.291115 8555 ts_tablet_manager.cc:1428] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 02:34:56.291306 8058 heartbeater.cc:503] Master 127.17.79.62:46477 was elected leader, sending a full tablet report...
Aug 11 02:34:56 dist-test-slave-7nm7 krb5kdc[5899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415695, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for HTTP/127.17.79.20@KRBTEST.COM
I20260811 02:34:56.461462 8561 raft_consensus.cc:482] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:34:56.461638 8561 raft_consensus.cc:504] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.462070 8561 leader_election.cc:288] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d61ca632eeb4da09aabfb245c1b12d6 (127.17.79.1:44679), 2f6cbfb162164e7fa4639f88cca7d9d3 (127.17.79.2:37919)
I20260811 02:34:56.466627 8546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.462354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:35841 (local address 127.17.79.2:37919)
0811 02:34:56.462486 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:56.462489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:56.462853 (+ 364us) server_negotiation.cc:407] Connection header received
0811 02:34:56.462891 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:56.462892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:56.462908 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:56.462983 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:56.463233 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.463955 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.465539 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.466156 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.466210 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.466223 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:56.466506 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 02:34:56.466555 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 02:34:56.466703 8545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.462489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:53029 (local address 127.17.79.1:44679)
0811 02:34:56.462568 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:56.462570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:56.462899 (+ 329us) server_negotiation.cc:407] Connection header received
0811 02:34:56.462930 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:56.462931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:56.462943 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:56.462993 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:34:56.463238 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.463960 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.465551 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.466158 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.466211 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.466222 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:56.466574 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 02:34:56.466622 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:34:56.466908 8570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.462260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37919 (local address 127.17.79.3:35841)
0811 02:34:56.462604 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:56.462616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:56.462661 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:56.463043 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:56.463044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:56.463046 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:56.463151 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.463154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.464066 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.464067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.465420 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.465424 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.466345 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.466346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.466416 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.466421 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:34:56.466772 (+ 351us) client_negotiation.cc:240] Negotiation successful
0811 02:34:56.466821 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":65,"thread_start_us":103,"threads_started":1}
I20260811 02:34:56.467330 8571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.462261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:44679 (local address 127.17.79.3:53029)
0811 02:34:56.462742 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:56.462750 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:56.462774 (+ 24us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:56.463061 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:56.463062 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:56.463065 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:34:56.463159 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.463160 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.464069 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.464070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.465436 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:56.465440 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.466316 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.466317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:56.466490 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.466494 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:34:56.467187 (+ 693us) client_negotiation.cc:240] Negotiation successful
0811 02:34:56.467232 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":79,"thread_start_us":85,"threads_started":1}
I20260811 02:34:56.467787 7981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3760d6107e2470ca28d8952c3b4dbf9" candidate_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" is_pre_election: true
I20260811 02:34:56.467978 7981 raft_consensus.cc:2454] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d3b3925a5f4f3a8636fce95cd1cd78 in term 0.
I20260811 02:34:56.468232 8309 leader_election.cc:302] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d3b3925a5f4f3a8636fce95cd1cd78, 0d61ca632eeb4da09aabfb245c1b12d6; no voters:
I20260811 02:34:56.468220 8204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3760d6107e2470ca28d8952c3b4dbf9" candidate_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" is_pre_election: true
I20260811 02:34:56.468382 8204 raft_consensus.cc:2454] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08d3b3925a5f4f3a8636fce95cd1cd78 in term 0.
I20260811 02:34:56.468374 8561 raft_consensus.cc:2781] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:34:56.468422 8561 raft_consensus.cc:482] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:34:56.468446 8561 raft_consensus.cc:3037] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:56.469412 8561 raft_consensus.cc:504] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.469550 8561 leader_election.cc:288] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [CANDIDATE]: Term 1 election: Requested vote from peers 0d61ca632eeb4da09aabfb245c1b12d6 (127.17.79.1:44679), 2f6cbfb162164e7fa4639f88cca7d9d3 (127.17.79.2:37919)
I20260811 02:34:56.469969 8204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3760d6107e2470ca28d8952c3b4dbf9" candidate_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3"
I20260811 02:34:56.470050 8204 raft_consensus.cc:3037] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:56.470944 8204 raft_consensus.cc:2454] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08d3b3925a5f4f3a8636fce95cd1cd78 in term 1.
I20260811 02:34:56.471019 7981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3760d6107e2470ca28d8952c3b4dbf9" candidate_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d61ca632eeb4da09aabfb245c1b12d6"
I20260811 02:34:56.471108 7981 raft_consensus.cc:3037] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:56.471166 8312 leader_election.cc:302] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08d3b3925a5f4f3a8636fce95cd1cd78, 2f6cbfb162164e7fa4639f88cca7d9d3; no voters:
I20260811 02:34:56.471283 8561 raft_consensus.cc:2781] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:34:56.471413 8561 raft_consensus.cc:686] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 1 LEADER]: Becoming Leader. State: Replica: 08d3b3925a5f4f3a8636fce95cd1cd78, State: Running, Role: LEADER
I20260811 02:34:56.471501 8561 consensus_queue.cc:237] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } }
I20260811 02:34:56.472002 7981 raft_consensus.cc:2454] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08d3b3925a5f4f3a8636fce95cd1cd78 in term 1.
W20260811 02:34:56.472167 8499 tablet.cc:2369] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:34:56.472805 7715 catalog_manager.cc:5495] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 08d3b3925a5f4f3a8636fce95cd1cd78 (127.17.79.3). New cstate: current_term: 1 leader_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08d3b3925a5f4f3a8636fce95cd1cd78" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 33363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 } health_report { overall_health: UNKNOWN } } }
W20260811 02:34:56.490665 8273 tablet.cc:2369] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:34:56.495194 8550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.487667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.17.79.3:33363)
0811 02:34:56.487925 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:56.487927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:56.487935 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:34:56.487976 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:56.487976 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:56.488002 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:56.488067 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:34:56.488277 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.489001 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.490116 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:56.490438 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:56.490511 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:56.494586 (+ 4075us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:34:56.494737 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:34:56.494819 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:56.495079 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 02:34:56.495113 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260811 02:34:56.497546 8204 raft_consensus.cc:1261] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 1 FOLLOWER]: Refusing update from remote peer 08d3b3925a5f4f3a8636fce95cd1cd78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:34:56.497915 8573 consensus_queue.cc:1035] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f6cbfb162164e7fa4639f88cca7d9d3" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:34:56.501156 7981 raft_consensus.cc:1261] T a3760d6107e2470ca28d8952c3b4dbf9 P 0d61ca632eeb4da09aabfb245c1b12d6 [term 1 FOLLOWER]: Refusing update from remote peer 08d3b3925a5f4f3a8636fce95cd1cd78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:34:56.501726 8573 consensus_queue.cc:1035] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d61ca632eeb4da09aabfb245c1b12d6" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 44679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:34:56.507440 8576 mvcc.cc:205] Tried to move back new op lower bound from 7317158692850913280 to 7317158692747788288. Current Snapshot: MvccSnapshot[applied={T|T < 7317158692850913280}]
I20260811 02:34:56.509124 8579 mvcc.cc:205] Tried to move back new op lower bound from 7317158692850913280 to 7317158692747788288. Current Snapshot: MvccSnapshot[applied={T|T < 7317158692850913280}]
I20260811 02:34:56.510630 8577 mvcc.cc:205] Tried to move back new op lower bound from 7317158692850913280 to 7317158692747788288. Current Snapshot: MvccSnapshot[applied={T|T < 7317158692850913280}]
I20260811 02:34:56.517408 7710 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:34:56.517514 7710 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:34:56.518510 7710 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f9daf47598f445c0a2f7a30802c22215: Sending DeleteTablet for 3 replicas of tablet a3760d6107e2470ca28d8952c3b4dbf9
I20260811 02:34:56.518975 7952 tablet_service.cc:1514] Processing DeleteTablet for tablet a3760d6107e2470ca28d8952c3b4dbf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:34:56 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:37978
I20260811 02:34:56.519011 8357 tablet_service.cc:1514] Processing DeleteTablet for tablet a3760d6107e2470ca28d8952c3b4dbf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:34:56 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:33380
I20260811 02:34:56.519280 8178 tablet_service.cc:1514] Processing DeleteTablet for tablet a3760d6107e2470ca28d8952c3b4dbf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:34:56 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:42714
I20260811 02:34:56.519500 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 7794
I20260811 02:34:56.548032 8589 tablet_replica.cc:330] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: stopping tablet replica
I20260811 02:34:56.548244 8587 tablet_replica.cc:330] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: stopping tablet replica
I20260811 02:34:56.548393 8587 raft_consensus.cc:2229] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:34:56.548535 8589 raft_consensus.cc:2229] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:34:56.548724 8587 raft_consensus.cc:2258] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:34:56.548870 8589 raft_consensus.cc:2258] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:34:56.563376 8587 ts_tablet_manager.cc:1905] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:34:56.563923 8589 ts_tablet_manager.cc:1905] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:34:56.566959 8589 ts_tablet_manager.cc:1918] T a3760d6107e2470ca28d8952c3b4dbf9 P 2f6cbfb162164e7fa4639f88cca7d9d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:34:56.568666 8587 ts_tablet_manager.cc:1918] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 02:34:56.569049 7679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:44679 (error 108)
I20260811 02:34:56.569794 8587 log.cc:1196] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/a3760d6107e2470ca28d8952c3b4dbf9
I20260811 02:34:56.570034 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 8063
I20260811 02:34:56.591270 8587 ts_tablet_manager.cc:1939] T a3760d6107e2470ca28d8952c3b4dbf9 P 08d3b3925a5f4f3a8636fce95cd1cd78: Deleting consensus metadata
I20260811 02:34:56.592374 7679 catalog_manager.cc:4841] TS 08d3b3925a5f4f3a8636fce95cd1cd78 (127.17.79.3:33363): tablet a3760d6107e2470ca28d8952c3b4dbf9 (table test-table [id=5c984fbfbf8e43aa8b2bb66836b03649]) successfully deleted
I20260811 02:34:56.593292 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.593137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:44679 (local address 127.0.0.1:37984)
0811 02:34:56.593197 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:56.593257 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 02:34:56.593438 7679 catalog_manager.cc:4584] TS 0d61ca632eeb4da09aabfb245c1b12d6 (127.17.79.1:44679): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a3760d6107e2470ca28d8952c3b4dbf9: Network error: Client connection negotiation failed: client connection to 127.17.79.1:44679: connect: Connection refused (error 111)
I20260811 02:34:56.602501 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 8276
I20260811 02:34:56.602723 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:56.602601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37919 (local address 127.0.0.1:42716)
0811 02:34:56.602654 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:56.602682 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.2:37919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 02:34:56.622596 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 7644
I20260811 02:34:56.633853 17724 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 02:34:56.978876 17724 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 02:34:56.978974 17724 mini_ranger.cc:66] Stopping Ranger...
I20260811 02:34:57.334167 17724 mini_ranger.cc:68] Stopped Ranger
2026-08-11 02:34:57.334 UTC [5959] LOG: received smart shutdown request
2026-08-11 02:34:57.339 UTC [5959] LOG: background worker "logical replication launcher" (PID 5971) exited with exit code 1
2026-08-11 02:34:57.339 UTC [5964] LOG: shutting down
2026-08-11 02:34:57.526 UTC [5959] LOG: database system is shut down
2026-08-11T02:34:57Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49645 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:34:57 dist-test-slave-7nm7 krb5kdc[8605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:34:57 dist-test-slave-7nm7 krb5kdc[8605](info): set up 2 sockets
Aug 11 02:34:57 dist-test-slave-7nm7 krb5kdc[8605](info): commencing operation
krb5kdc: starting...
W20260811 02:34:58.953092 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:34:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:34:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:34:59.089412 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43887
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43887,127.17.79.61:38491,127.17.79.60:40679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:34:59.180213 8627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:59.180438 8627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:59.180464 8627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:59.181535 8627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:34:59.181576 8627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:59.181592 8627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:59.181607 8627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:34:59.181620 8627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:34:59.183347 8627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43887,127.17.79.61:38491,127.17.79.60:40679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:59.183573 8627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:59.183760 8627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:59.188875 8634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:59.188884 8645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:59.189031 8627 server_base.cc:1034] running on GCE node
W20260811 02:34:59.188884 8638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:59.189540 8627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:59.189831 8627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:59.190971 8627 hybrid_clock.cc:648] HybridClock initialized: now 1786415699190939 us; error 49 us; skew 500 ppm
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:59.193670 8627 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:34:59.194168 8627 webserver.cc:460] Webserver started at http://127.17.79.62:34449/ using document root <none> and password file <none>
I20260811 02:34:59.194418 8627 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:59.194489 8627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:59.194655 8627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:34:59.195740 8627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "4046b510f4a54cb498754f12b4c4913d"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "f95329ce27e71c8ad3f8ce8f1c4ee784"
server_key_iv: "eab67164647384b5a6f92f4662a4ebfb"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.196115 8627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "4046b510f4a54cb498754f12b4c4913d"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "f95329ce27e71c8ad3f8ce8f1c4ee784"
server_key_iv: "eab67164647384b5a6f92f4662a4ebfb"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.197466 8627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:34:59.198313 8655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:59.198494 8627 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:59.198612 8627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "4046b510f4a54cb498754f12b4c4913d"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "f95329ce27e71c8ad3f8ce8f1c4ee784"
server_key_iv: "eab67164647384b5a6f92f4662a4ebfb"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.198686 8627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:59.227373 8627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:59.229760 8627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:59.229933 8627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:59.234197 8627 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:43887
I20260811 02:34:59.234284 8749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:43887 every 8 connection(s)
I20260811 02:34:59.234647 8627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:34:59.235510 8750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:59.235798 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 8627
I20260811 02:34:59.235921 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:34:59.236121 17724 external_mini_cluster.cc:1428] Setting key d37903e40dcd36a0f9d2e4a53664cdae
I20260811 02:34:59.237248 8750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.79.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.61@KRBTEST.COM" created.
I20260811 02:34:59.247927 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.237939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42760 (local address 127.17.79.62:43887)
0811 02:34:59.238141 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.238151 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.238283 (+ 132us) server_negotiation.cc:407] Connection header received
0811 02:34:59.238837 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.238840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.238863 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.238976 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.239710 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.240491 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.241898 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.242216 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.242377 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.244630 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.244637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.244637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.244644 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.246273 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.246668 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.246671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.246671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.246750 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.246990 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.246991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.246991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.247226 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.247326 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.247514 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.247692 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260811 02:34:59.247931 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.237939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43887 (local address 127.0.0.1:42760)
0811 02:34:59.238137 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.238173 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.238674 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.239000 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.239003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.239393 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.239614 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.239620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.240595 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.240597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.241792 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.241795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.242368 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.242370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.242461 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.242948 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.242959 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.244537 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.246372 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.246379 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.246381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.246571 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.246825 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.246826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.246826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.246933 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.247316 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.247321 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.247383 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.247488 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.247739 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":126,"spinlock_wait_cycles":6912,"thread_start_us":98,"threads_started":1}
I20260811 02:34:59.248646 8750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:34:59.248981 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.248873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45860)
0811 02:34:59.248920 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.248960 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 02:34:59.249136 8664 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
I20260811 02:34:59.249603 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.249496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45868)
0811 02:34:59.249546 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.249579 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 02:34:59.249747 8750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:38491: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab.
Entry for principal kudu/127.17.79.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab.
I20260811 02:34:59.263119 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:38491
--webserver_interface=127.17.79.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab
--principal=kudu/127.17.79.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43887,127.17.79.61:38491,127.17.79.60:40679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:34:59.299007 8750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } attempt: 1
I20260811 02:34:59.299525 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.299385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45884)
0811 02:34:59.299452 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.299493 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 02:34:59.299885 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.299784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45888)
0811 02:34:59.299831 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.299856 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 02:34:59.299986 8750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:38491: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
W20260811 02:34:59.345495 8760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:59.345782 8760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:59.345824 8760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:59.347049 8760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:34:59.347127 8760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:59.347152 8760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:59.347175 8760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:34:59.347201 8760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:34:59.348757 8760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43887,127.17.79.61:38491,127.17.79.60:40679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab
--principal=kudu/127.17.79.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:38491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.79.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:59.349056 8760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:59.349294 8760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:59.354291 8769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:59.354291 8771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:59.354298 8768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:59.354612 8760 server_base.cc:1034] running on GCE node
I20260811 02:34:59.354833 8760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:59.355299 8760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:59.356650 8760 hybrid_clock.cc:648] HybridClock initialized: now 1786415699356609 us; error 51 us; skew 500 ppm
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:59.359747 8760 init.cc:377] Logged in from keytab as kudu/127.17.79.61@KRBTEST.COM (short username kudu)
I20260811 02:34:59.360416 8760 webserver.cc:460] Webserver started at http://127.17.79.61:45907/ using document root <none> and password file <none>
I20260811 02:34:59.360677 8760 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:59.360728 8760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:59.360896 8760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:34:59.361989 8760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data/instance:
uuid: "e96f1f4d10da4d7ba21a52d431cccd24"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "9f24e3a645cae395edd8633baf160b6e"
server_key_iv: "f70bff2b950caaae3d0b14f0053485cc"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.362542 8760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/wal/instance:
uuid: "e96f1f4d10da4d7ba21a52d431cccd24"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "9f24e3a645cae395edd8633baf160b6e"
server_key_iv: "f70bff2b950caaae3d0b14f0053485cc"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.363945 8760 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:59.365180 8783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:59.365561 8760 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:34:59.365685 8760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/wal
uuid: "e96f1f4d10da4d7ba21a52d431cccd24"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "9f24e3a645cae395edd8633baf160b6e"
server_key_iv: "f70bff2b950caaae3d0b14f0053485cc"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.365760 8760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:59.368103 8750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } attempt: 2
I20260811 02:34:59.368564 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.368433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45900)
0811 02:34:59.368492 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.368526 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 02:34:59.368911 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.368815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45912)
0811 02:34:59.368863 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.368888 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 02:34:59.369033 8750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:38491: Network error: Client connection negotiation failed: client connection to 127.17.79.61:38491: connect: Connection refused (error 111)
I20260811 02:34:59.376747 8760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:59.378898 8760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:59.379076 8760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:59.383122 8760 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.61:38491
I20260811 02:34:59.383180 8864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.61:38491 every 8 connection(s)
I20260811 02:34:59.383606 8760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
I20260811 02:34:59.384475 8866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:59.386126 8866 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:34:59.388569 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 8760
I20260811 02:34:59.388679 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-1/wal/instance
I20260811 02:34:59.388895 17724 external_mini_cluster.cc:1428] Setting key b50ec98c6fe0c9bfc7f24911853c2144
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:59.396195 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.386886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42762 (local address 127.17.79.62:43887)
0811 02:34:59.386929 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.386931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.387154 (+ 223us) server_negotiation.cc:407] Connection header received
0811 02:34:59.387670 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.387672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.387688 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.387762 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.388379 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.389189 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.390190 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.390553 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.390631 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.393199 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.393200 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.393201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.393207 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.394720 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.395233 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.395235 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.395235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.395286 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.395573 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.395573 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.395574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.395684 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.395743 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.396067 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.396131 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:34:59.396481 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.386857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43887 (local address 127.0.0.1:42762)
0811 02:34:59.387037 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.387071 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.387562 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.387830 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.387834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.388086 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.388282 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.388286 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.389304 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.389304 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.390100 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.390103 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.390671 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.390672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.390832 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.391336 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.391347 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.393092 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.394811 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.394819 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.394821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.395148 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.395355 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.395356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.395356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.395505 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.395748 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.395755 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.395926 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.396050 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.396242 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":81,"threads_started":1}
I20260811 02:34:59.397105 8866 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.79.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.60@KRBTEST.COM" created.
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:34:59.404868 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.397474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45916 (local address 127.17.79.61:38491)
0811 02:34:59.397640 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.397643 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.397698 (+ 55us) server_negotiation.cc:407] Connection header received
0811 02:34:59.397771 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.397772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.397783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.397843 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.398157 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.398872 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.399523 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.399808 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.399868 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.401842 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.401851 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.401852 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.401860 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.403605 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.404013 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.404015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.404016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.404067 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.404273 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.404274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.404274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.404400 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.404463 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.404628 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.404781 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":139,"thread_start_us":102,"threads_started":1}
I20260811 02:34:59.404874 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.397372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45916)
0811 02:34:59.397636 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.397648 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.397705 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.397849 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.397850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.398019 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.398084 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.398086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.398977 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.398977 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.399452 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.399453 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.399895 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.399896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.399992 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.400360 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.400365 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.401757 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.403693 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.403695 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.403695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.403929 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.404133 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.404134 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.404134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.404205 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.404468 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.404469 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.404518 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.404594 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.404704 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247}
I20260811 02:34:59.405687 8866 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:34:59.406060 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.405921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52502)
0811 02:34:59.405973 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.406025 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 02:34:59.406185 8787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
I20260811 02:34:59.406672 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.406575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52516)
0811 02:34:59.406627 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.406653 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 02:34:59.406802 8866 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:40679: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab.
Entry for principal kudu/127.17.79.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab.
I20260811 02:34:59.418128 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:40679
--webserver_interface=127.17.79.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab
--principal=kudu/127.17.79.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43887,127.17.79.61:38491,127.17.79.60:40679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:34:59.456089 8866 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } attempt: 1
I20260811 02:34:59.456684 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.456533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52528)
0811 02:34:59.456615 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.456654 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 02:34:59.457060 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.456955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52530)
0811 02:34:59.457003 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.457031 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 02:34:59.457165 8866 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:40679: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
I20260811 02:34:59.460183 8750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } attempt: 3
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:34:59.467530 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.460650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45922 (local address 127.17.79.61:38491)
0811 02:34:59.460712 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.460714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.460726 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:34:59.460795 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.460796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.460808 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.460881 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.461203 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.461708 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.462475 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.462759 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.462840 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.464899 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.464900 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.464901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.464908 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.466394 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.466747 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.466748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.466748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.466808 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.467005 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.467006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.467006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.467123 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.467201 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.467369 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.467444 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 02:34:59.467530 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.460583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45922)
0811 02:34:59.460641 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.460655 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.460727 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.460887 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.460888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.461052 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.461118 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.461120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.461815 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.461816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.462393 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.462395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.462837 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.462839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.462921 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.463401 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.463406 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.464806 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.466484 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.466485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.466486 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.466653 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.466876 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.466877 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.466877 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.466939 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.467191 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.467192 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.467251 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.467331 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.467434 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 02:34:59.468010 8750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:34:59.468444 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.468331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52532)
0811 02:34:59.468385 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.468416 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 02:34:59.468792 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.468732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52546)
0811 02:34:59.468757 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.468778 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 02:34:59.468894 8750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:40679: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
I20260811 02:34:59.500075 8750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } attempt: 1
I20260811 02:34:59.500877 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.500742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52552)
0811 02:34:59.500806 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.500848 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 02:34:59.501266 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.501159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52562)
0811 02:34:59.501206 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.501234 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 02:34:59.501372 8750 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:40679: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
W20260811 02:34:59.508888 8878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:34:59.509155 8878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:34:59.509217 8878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:34:59.510484 8878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:34:59.510545 8878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:34:59.510573 8878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:34:59.510607 8878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:34:59.510630 8878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:34:59.512238 8878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43887,127.17.79.61:38491,127.17.79.60:40679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab
--principal=kudu/127.17.79.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:40679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.79.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:34:59.512537 8878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:34:59.512778 8878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:34:59.517612 8889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:59.517616 8894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:34:59.517628 8890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:34:59.517923 8878 server_base.cc:1034] running on GCE node
I20260811 02:34:59.518169 8878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:34:59.518544 8878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:34:59.519716 8878 hybrid_clock.cc:648] HybridClock initialized: now 1786415699519706 us; error 42 us; skew 500 ppm
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:34:59.522743 8878 init.cc:377] Logged in from keytab as kudu/127.17.79.60@KRBTEST.COM (short username kudu)
I20260811 02:34:59.523200 8878 webserver.cc:460] Webserver started at http://127.17.79.60:46615/ using document root <none> and password file <none>
I20260811 02:34:59.523444 8878 fs_manager.cc:359] Metadata directory not provided
I20260811 02:34:59.523543 8878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:34:59.523669 8878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:34:59.524690 8878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data/instance:
uuid: "d6890626f68f4e049c8ee241449bafae"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "6559208e5e0cd0bcabb359365324ba4f"
server_key_iv: "a2fb57355b0fb3803b8297d5d289668b"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.525017 8878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/wal/instance:
uuid: "d6890626f68f4e049c8ee241449bafae"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "6559208e5e0cd0bcabb359365324ba4f"
server_key_iv: "a2fb57355b0fb3803b8297d5d289668b"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.525329 8866 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } attempt: 2
I20260811 02:34:59.525735 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.525596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52566)
0811 02:34:59.525664 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.525701 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 02:34:59.526142 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.526044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52582)
0811 02:34:59.526092 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.526124 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 02:34:59.526292 8866 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:40679: Network error: Client connection negotiation failed: client connection to 127.17.79.60:40679: connect: Connection refused (error 111)
I20260811 02:34:59.526708 8878 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 02:34:59.527588 8904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:34:59.527832 8878 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:34:59.527959 8878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/wal
uuid: "d6890626f68f4e049c8ee241449bafae"
format_stamp: "Formatted at 2026-08-11 02:34:59 on dist-test-slave-7nm7"
server_key: "6559208e5e0cd0bcabb359365324ba4f"
server_key_iv: "a2fb57355b0fb3803b8297d5d289668b"
server_key_version: "encryptionkey@0"
I20260811 02:34:59.528036 8878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:34:59.544420 8878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:34:59.546676 8878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:34:59.546845 8878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:34:59.551106 8878 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.60:40679
I20260811 02:34:59.551156 8990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.60:40679 every 8 connection(s)
I20260811 02:34:59.551524 8878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
I20260811 02:34:59.552436 8992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:34:59.554039 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 8878
I20260811 02:34:59.554131 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786415535404356-17724-0/minicluster-data/master-2/wal/instance
I20260811 02:34:59.553987 8992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:34:59.554390 17724 external_mini_cluster.cc:1428] Setting key 4f730aa47426fa968199731c790e9065
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:34:59.564091 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.554854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42768 (local address 127.17.79.62:43887)
0811 02:34:59.554907 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.554910 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.555179 (+ 269us) server_negotiation.cc:407] Connection header received
0811 02:34:59.555733 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.555734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.555747 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.555816 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.556333 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.556841 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.557923 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.558385 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.558453 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.561043 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.561045 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.561045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.561053 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.562685 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.563131 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.563133 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.563133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.563189 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.563457 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.563458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.563458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.563575 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.563646 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.563915 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.564001 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:34:59.564335 8999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.554831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52590 (local address 127.17.79.60:40679)
0811 02:34:59.554995 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.555005 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.555071 (+ 66us) server_negotiation.cc:407] Connection header received
0811 02:34:59.555608 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.555617 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.555644 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.555735 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.556397 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.557358 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.558334 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.558828 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.558904 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.561473 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.561482 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.561482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.561489 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.562966 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.563335 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.563344 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.563344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.563398 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.563606 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.563607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.563607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.563790 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.563956 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.564028 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.564106 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260811 02:34:59.564352 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.554831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43887 (local address 127.0.0.1:42768)
0811 02:34:59.555012 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.555048 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.555606 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.555852 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.555854 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.556093 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.556240 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.556244 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.556920 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.556921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.557807 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.557810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.558503 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.558504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.558725 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.559303 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.559311 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.560946 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.562792 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.562799 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.562801 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.563037 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.563266 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.563267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.563268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.563379 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.563651 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.563658 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.563786 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.563880 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.564028 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260811 02:34:59.565116 8992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:34:59.571943 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.565361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:38491 (local address 127.0.0.1:45936)
0811 02:34:59.565411 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.565421 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.565452 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.565618 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.565618 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.565729 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.565772 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.565773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.566549 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.566550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.567066 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.567067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.567462 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.567463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.567538 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.568063 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.568068 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.569269 (+ 1201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.570918 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.570919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.570919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.571090 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.571313 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.571313 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.571314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.571373 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.571629 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.571630 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.571672 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.571754 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.571848 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 02:34:59.571949 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.565445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45936 (local address 127.17.79.61:38491)
0811 02:34:59.565498 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.565500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.565510 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:34:59.565533 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.565535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.565545 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.565602 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.565851 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.566478 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.567142 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.567394 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.567444 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.569344 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.569345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.569345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.569352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.570831 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.571177 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.571178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.571178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.571237 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.571446 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.571447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.571447 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.571561 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.571636 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.571792 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.571865 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:34:59.572340 8992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:34:59.572731 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.565187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.17.79.62:43887)
0811 02:34:59.565227 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.565228 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.565237 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:34:59.565303 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.565304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.565314 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.565404 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.566072 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.566596 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.567255 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.567445 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.567512 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.570017 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.570019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.570019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.570026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.571438 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.571811 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.571812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.571813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.571871 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.572086 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.572088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.572088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.572225 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.572375 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.572559 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.572633 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:34:59.576504 8750 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } attempt: 2
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:34:59.579991 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.572602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52600)
0811 02:34:59.572643 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.572652 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.572697 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.572821 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.572822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.572951 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.572975 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.572976 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.573666 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.573667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.574242 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.574266 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.574713 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.574714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.574757 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.575128 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.575133 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.576270 (+ 1137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.578892 (+ 2622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.578893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.578894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.579103 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.579345 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.579346 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.579347 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.579416 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.579701 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.579702 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.579738 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.579803 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.579891 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 02:34:59.580266 8999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.572637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52600 (local address 127.17.79.60:40679)
0811 02:34:59.572669 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.572670 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.572685 (+ 15us) server_negotiation.cc:407] Connection header received
0811 02:34:59.572762 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.572763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.572773 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.572818 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.573057 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.573591 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.574345 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.574634 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.574696 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.576355 (+ 1659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.576356 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.576356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.576363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.578813 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.579195 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.579195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.579195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.579272 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.579487 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.579488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.579488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.579620 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.579680 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.580108 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.580192 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:34:59.581738 8992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: Bootstrap starting.
I20260811 02:34:59.582540 8992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:59.582856 8992 log.cc:824] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:59.583101 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.573679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45940 (local address 127.17.79.61:38491)
0811 02:34:59.573720 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.573722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.573729 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:34:59.573768 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.573769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.573778 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.573836 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.574262 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.574886 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.575580 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.575773 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.575859 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.578186 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.578187 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.578187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.578194 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.580585 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.581407 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.581409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.581409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.581465 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.581711 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.581712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.581713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.581854 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.582845 (+ 991us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.582895 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.582985 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:34:59.583681 8992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: No bootstrap required, opened a new log
I20260811 02:34:59.584501 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:34:59.584928 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.576735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52614)
0811 02:34:59.576781 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.576791 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.576826 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.577147 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.577149 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.577295 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.577356 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.577358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.578473 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.578474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.579170 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.579173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.579632 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.579633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.579709 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.580369 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.580374 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.581635 (+ 1261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.583760 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.583761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.583762 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.583987 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.584230 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.584231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.584232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.584299 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.584562 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.584563 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.584607 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.584711 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.584822 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 02:34:59.584954 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.576768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52614 (local address 127.17.79.60:40679)
0811 02:34:59.576981 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.576983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.576992 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:34:59.577014 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.577014 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.577030 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.577125 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.577431 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.578356 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.579250 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.579537 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.579835 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.581743 (+ 1908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.581744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.581744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.581751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.583655 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.584071 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.584071 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.584072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.584122 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.584352 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.584353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.584354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.584486 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.584567 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.584739 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.584823 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":125,"threads_started":1}
I20260811 02:34:59.586575 8750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: Bootstrap starting.
I20260811 02:34:59.587364 8750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:59.587328 8992 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.587489 8992 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:59.587529 8992 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6890626f68f4e049c8ee241449bafae, State: Initialized, Role: FOLLOWER
I20260811 02:34:59.587663 8750 log.cc:824] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:59.587661 8992 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.587996 8992 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:34:59.588590 8750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: No bootstrap required, opened a new log
I20260811 02:34:59.590821 9019 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.590811 8750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.590941 8750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:59.590992 8750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4046b510f4a54cb498754f12b4c4913d, State: Initialized, Role: FOLLOWER
I20260811 02:34:59.591020 9019 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:34:59.591097 8750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.591514 8750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [sys.catalog]: configured and running, proceeding with master startup.
W20260811 02:34:59.592028 9042 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:34:59.592072 9042 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:34:59.593248 9044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.590951 8878 master_runner.cc:186] Error getting master registration for 127.17.79.62:43887: OK, instance_id { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" instance_seqno: 1786415699233041 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 02:34:59.593384 9044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 02:34:59.593290 9065 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 02:34:59.593420 8878 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 02:34:59.593449 9065 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:34:59.594321 8627 master_runner.cc:186] Error getting master registration for 127.17.79.61:38491: OK, instance_id { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" instance_seqno: 1786415699381861 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 02:34:59.596570 8627 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 02:34:59.598407 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.586023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42786 (local address 127.17.79.62:43887)
0811 02:34:59.586060 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.586062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.586378 (+ 316us) server_negotiation.cc:407] Connection header received
0811 02:34:59.586477 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.586478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.586487 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.586516 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.587265 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.587953 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.588967 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.589242 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.589282 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.593940 (+ 4658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.593942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.593942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.593949 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.595662 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.597436 (+ 1774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.597438 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.597438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.597499 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.597728 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.597729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.597729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.597866 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.597952 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.598182 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.598290 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:34:59.602110 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.586393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45952 (local address 127.17.79.61:38491)
0811 02:34:59.586431 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.586432 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.586919 (+ 487us) server_negotiation.cc:407] Connection header received
0811 02:34:59.587012 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.587013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.587024 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.587053 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.587821 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.588494 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.589569 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.589852 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.589916 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.598728 (+ 8812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.598730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.598730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.598737 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.600463 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.601153 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.601154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.601154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.601226 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.601440 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.601441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.601441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.601578 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.601667 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.601920 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.602006 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:34:59.603287 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.586663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52628 (local address 127.17.79.60:40679)
0811 02:34:59.586696 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.586698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.590646 (+ 3948us) server_negotiation.cc:407] Connection header received
0811 02:34:59.590730 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.590731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.590743 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.590791 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.591386 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.592138 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.593840 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.594159 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.594215 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.599940 (+ 5725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.599942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.599942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.599950 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.601651 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.602379 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.602381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.602381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.602443 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.602667 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.602668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.602668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.602825 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.602906 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.603102 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.603195 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 02:34:59.617439 8866 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } attempt: 3
Aug 11 02:34:59 dist-test-slave-7nm7 krb5kdc[8605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:34:59.624888 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.617764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:40679 (local address 127.0.0.1:52632)
0811 02:34:59.617823 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 02:34:59.617834 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:34:59.617872 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:34:59.618028 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:34:59.618030 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:34:59.618203 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:34:59.618305 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.618307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.619351 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.619352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.619860 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:34:59.619862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.620261 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.620262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:34:59.620319 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.620799 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:34:59.620804 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:34:59.622038 (+ 1234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:34:59.623760 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.623761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.623761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.623936 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.624149 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:34:59.624150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:34:59.624151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:34:59.624224 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:34:59.624544 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:34:59.624546 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:34:59.624592 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 02:34:59.624640 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 02:34:59.624783 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:34:59.625490 9003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:34:59.617818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52632 (local address 127.17.79.60:40679)
0811 02:34:59.617858 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:34:59.617860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:34:59.617876 (+ 16us) server_negotiation.cc:407] Connection header received
0811 02:34:59.617932 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:34:59.617932 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:34:59.617940 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:34:59.618007 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:34:59.618390 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.619262 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.619960 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:34:59.620167 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:34:59.620260 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:34:59.622131 (+ 1871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:34:59.622133 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:34:59.622133 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:34:59.622141 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:34:59.623657 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.624020 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.624022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.624022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.624084 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:34:59.624312 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:34:59.624313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:34:59.624313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:34:59.624461 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:34:59.625320 (+ 859us) server_negotiation.cc:1035] Waiting for connection context
0811 02:34:59.625367 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 02:34:59.625431 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:34:59.627022 8866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24: Bootstrap starting.
I20260811 02:34:59.627702 8866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24: Neither blocks nor log segments found. Creating new log.
I20260811 02:34:59.628007 8866 log.cc:824] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24: Log is configured to *not* fsync() on all Append() calls
I20260811 02:34:59.628803 8866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24: No bootstrap required, opened a new log
I20260811 02:34:59.630541 8866 raft_consensus.cc:348] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.630760 8866 raft_consensus.cc:374] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:34:59.630849 8866 raft_consensus.cc:729] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e96f1f4d10da4d7ba21a52d431cccd24, State: Initialized, Role: FOLLOWER
I20260811 02:34:59.631062 8866 consensus_queue.cc:260] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.631410 9069 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.631485 8866 sys_catalog.cc:564] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:34:59.631556 9069 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 02:34:59.634361 9083 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:34:59.634455 9083 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:34:59.636687 8760 master_runner.cc:263] No leader master found from master e96f1f4d10da4d7ba21a52d431cccd24
I20260811 02:34:59.636744 8760 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 02:34:59.730829 8668 tablet.cc:2369] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:34:59.797569 8923 tablet.cc:2369] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:34:59.867838 9069 raft_consensus.cc:482] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:34:59.867982 9069 raft_consensus.cc:504] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.868269 9069 leader_election.cc:288] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4046b510f4a54cb498754f12b4c4913d (127.17.79.62:43887), d6890626f68f4e049c8ee241449bafae (127.17.79.60:40679)
I20260811 02:34:59.868559 8953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6890626f68f4e049c8ee241449bafae" is_pre_election: true
I20260811 02:34:59.868537 8711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4046b510f4a54cb498754f12b4c4913d" is_pre_election: true
I20260811 02:34:59.868701 8711 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e96f1f4d10da4d7ba21a52d431cccd24 in term 0.
I20260811 02:34:59.868705 8953 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e96f1f4d10da4d7ba21a52d431cccd24 in term 0.
I20260811 02:34:59.868894 8787 leader_election.cc:302] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6890626f68f4e049c8ee241449bafae, e96f1f4d10da4d7ba21a52d431cccd24; no voters:
I20260811 02:34:59.869053 9069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:34:59.869127 9069 raft_consensus.cc:482] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:34:59.869161 9069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:59.869915 9069 raft_consensus.cc:504] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.870059 9069 leader_election.cc:288] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [CANDIDATE]: Term 1 election: Requested vote from peers 4046b510f4a54cb498754f12b4c4913d (127.17.79.62:43887), d6890626f68f4e049c8ee241449bafae (127.17.79.60:40679)
I20260811 02:34:59.870263 8711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4046b510f4a54cb498754f12b4c4913d"
I20260811 02:34:59.870311 8953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6890626f68f4e049c8ee241449bafae"
I20260811 02:34:59.870365 8711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:59.870398 8953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:34:59.871054 8711 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e96f1f4d10da4d7ba21a52d431cccd24 in term 1.
I20260811 02:34:59.871107 8953 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e96f1f4d10da4d7ba21a52d431cccd24 in term 1.
I20260811 02:34:59.871271 8787 leader_election.cc:302] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4046b510f4a54cb498754f12b4c4913d, e96f1f4d10da4d7ba21a52d431cccd24; no voters:
I20260811 02:34:59.871402 9069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:34:59.871534 9069 raft_consensus.cc:686] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [term 1 LEADER]: Becoming Leader. State: Replica: e96f1f4d10da4d7ba21a52d431cccd24, State: Running, Role: LEADER
I20260811 02:34:59.871649 9069 consensus_queue.cc:237] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } }
I20260811 02:34:59.872093 9086 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e96f1f4d10da4d7ba21a52d431cccd24. Latest consensus state: current_term: 1 leader_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.872186 9086 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:59.872375 9089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:34:59.872560 9089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:34:59.873936 8711 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [term 1 FOLLOWER]: Refusing update from remote peer e96f1f4d10da4d7ba21a52d431cccd24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:34:59.873993 8953 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [term 1 FOLLOWER]: Refusing update from remote peer e96f1f4d10da4d7ba21a52d431cccd24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:34:59.874282 9086 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:34:59.874423 9069 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:34:59.875644 9019 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [sys.catalog]: SysCatalogTable state changed. Reason: New leader e96f1f4d10da4d7ba21a52d431cccd24. Latest consensus state: current_term: 1 leader_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.875648 9044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e96f1f4d10da4d7ba21a52d431cccd24. Latest consensus state: current_term: 1 leader_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.875730 9044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:34:59.875749 9019 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:34:59.876628 9086 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.876715 9086 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:59.876748 9086 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.876780 9086 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24 [sys.catalog]: This master's current role is: LEADER
I20260811 02:34:59.876809 9044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.876822 9095 mvcc.cc:205] Tried to move back new op lower bound from 7317158706681344000 to 7317158706675027968. Current Snapshot: MvccSnapshot[applied={T|T < 7317158706681344000}]
I20260811 02:34:59.876868 9044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:34:59.876904 9092 mvcc.cc:205] Tried to move back new op lower bound from 7317158706681344000 to 7317158706675027968. Current Snapshot: MvccSnapshot[applied={T|T < 7317158706681344000}]
I20260811 02:34:59.876910 9019 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4046b510f4a54cb498754f12b4c4913d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43887 } } peers { permanent_uuid: "e96f1f4d10da4d7ba21a52d431cccd24" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 38491 } } peers { permanent_uuid: "d6890626f68f4e049c8ee241449bafae" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 40679 } } }
I20260811 02:34:59.876973 9019 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:34:59.877147 9089 catalog_manager.cc:1347] Generated new cluster ID: 04907e42df05457fb6349022679d6d5a
I20260811 02:34:59.877198 9089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:34:59.893478 9089 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:34:59.894107 9089 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:34:59.906191 9089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e96f1f4d10da4d7ba21a52d431cccd24: Generated new TSK 0
I20260811 02:34:59.906446 9089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:35:00.592538 9042 catalog_manager.cc:1259] Loaded cluster ID: 04907e42df05457fb6349022679d6d5a
I20260811 02:35:00.592618 9042 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: loading cluster ID for follower catalog manager: success
I20260811 02:35:00.593531 9042 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: acquiring CA information for follower catalog manager: success
I20260811 02:35:00.593847 9042 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d6890626f68f4e049c8ee241449bafae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 02:35:00.593858 9065 catalog_manager.cc:1259] Loaded cluster ID: 04907e42df05457fb6349022679d6d5a
I20260811 02:35:00.593937 9065 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: loading cluster ID for follower catalog manager: success
I20260811 02:35:00.595189 9065 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: acquiring CA information for follower catalog manager: success
I20260811 02:35:00.595494 9065 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4046b510f4a54cb498754f12b4c4913d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 02:35:00.965413 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 8627
I20260811 02:35:00.980638 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 8760
I20260811 02:35:00.991556 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 8878
2026-08-11T02:35:01Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3361 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:35:01 dist-test-slave-7nm7 krb5kdc[9116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:35:01 dist-test-slave-7nm7 krb5kdc[9116](info): set up 2 sockets
Aug 11 02:35:01 dist-test-slave-7nm7 krb5kdc[9116](info): commencing operation
krb5kdc: starting...
W20260811 02:35:02.313678 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:35:02 dist-test-slave-7nm7 krb5kdc[9116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:35:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:35:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:35:02.445816 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43119
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:44919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:02.531085 9141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:02.531332 9141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:02.531356 9141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:02.532429 9141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:35:02.532466 9141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:02.532480 9141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:02.532493 9141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:35:02.532505 9141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:35:02.533927 9141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:44919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:02.534127 9141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:02.534346 9141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:02.539465 9159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:02.539521 9141 server_base.cc:1034] running on GCE node
W20260811 02:35:02.539450 9150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:02.539436 9152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:02.540031 9141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:02.540336 9141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:02.541513 9141 hybrid_clock.cc:648] HybridClock initialized: now 1786415702541493 us; error 39 us; skew 500 ppm
Aug 11 02:35:02 dist-test-slave-7nm7 krb5kdc[9116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415702, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:02.544445 9141 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:35:02.544932 9141 webserver.cc:460] Webserver started at http://127.17.79.62:38029/ using document root <none> and password file <none>
I20260811 02:35:02.545197 9141 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:02.545245 9141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:02.545368 9141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:02.546545 9141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "d52cd4094801416ea1fa573df2ce55b5"
format_stamp: "Formatted at 2026-08-11 02:35:02 on dist-test-slave-7nm7"
server_key: "28dce7242e5f6e37b3e187eef9b66876"
server_key_iv: "df312d94e758d80f77fcb85520dacb77"
server_key_version: "encryptionkey@0"
I20260811 02:35:02.546907 9141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "d52cd4094801416ea1fa573df2ce55b5"
format_stamp: "Formatted at 2026-08-11 02:35:02 on dist-test-slave-7nm7"
server_key: "28dce7242e5f6e37b3e187eef9b66876"
server_key_iv: "df312d94e758d80f77fcb85520dacb77"
server_key_version: "encryptionkey@0"
I20260811 02:35:02.548372 9141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:35:02.549253 9170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:02.549470 9141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:02.549561 9141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "d52cd4094801416ea1fa573df2ce55b5"
format_stamp: "Formatted at 2026-08-11 02:35:02 on dist-test-slave-7nm7"
server_key: "28dce7242e5f6e37b3e187eef9b66876"
server_key_iv: "df312d94e758d80f77fcb85520dacb77"
server_key_version: "encryptionkey@0"
I20260811 02:35:02.549628 9141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:02.560345 9141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:02.562721 9141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:02.562834 9141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:02.566891 9141 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:43119
I20260811 02:35:02.566949 9251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:43119 every 8 connection(s)
I20260811 02:35:02.567291 9141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:35:02.568226 9253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:02.570663 9253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5: Bootstrap starting.
I20260811 02:35:02.571250 9253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:02.571539 9253 log.cc:824] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:02.572376 9253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5: No bootstrap required, opened a new log
I20260811 02:35:02.572810 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 9141
I20260811 02:35:02.572921 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:35:02.573144 17724 external_mini_cluster.cc:1428] Setting key 02f6cd0e0475441d99cbadc4d39c425c
I20260811 02:35:02.574986 9253 raft_consensus.cc:348] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52cd4094801416ea1fa573df2ce55b5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43119 } }
I20260811 02:35:02.575240 9253 raft_consensus.cc:374] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:02.575297 9253 raft_consensus.cc:729] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d52cd4094801416ea1fa573df2ce55b5, State: Initialized, Role: FOLLOWER
I20260811 02:35:02.575449 9253 consensus_queue.cc:260] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52cd4094801416ea1fa573df2ce55b5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43119 } }
I20260811 02:35:02.575556 9253 raft_consensus.cc:388] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:35:02.575608 9253 raft_consensus.cc:482] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:35:02.575664 9253 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:02.576391 9253 raft_consensus.cc:504] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52cd4094801416ea1fa573df2ce55b5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43119 } }
I20260811 02:35:02.576488 9253 leader_election.cc:302] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d52cd4094801416ea1fa573df2ce55b5; no voters:
I20260811 02:35:02.576742 9253 leader_election.cc:288] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:35:02.576768 9260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:35:02.576897 9260 raft_consensus.cc:686] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [term 1 LEADER]: Becoming Leader. State: Replica: d52cd4094801416ea1fa573df2ce55b5, State: Running, Role: LEADER
I20260811 02:35:02.577054 9253 sys_catalog.cc:564] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:35:02.577054 9260 consensus_queue.cc:237] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52cd4094801416ea1fa573df2ce55b5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43119 } }
I20260811 02:35:02.578351 9262 sys_catalog.cc:455] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d52cd4094801416ea1fa573df2ce55b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52cd4094801416ea1fa573df2ce55b5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43119 } } }
I20260811 02:35:02.578474 9262 sys_catalog.cc:458] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:02.578991 9264 sys_catalog.cc:455] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d52cd4094801416ea1fa573df2ce55b5. Latest consensus state: current_term: 1 leader_uuid: "d52cd4094801416ea1fa573df2ce55b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d52cd4094801416ea1fa573df2ce55b5" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43119 } } }
I20260811 02:35:02.579274 9264 sys_catalog.cc:458] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5 [sys.catalog]: This master's current role is: LEADER
W20260811 02:35:02.579734 9289 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:35:02.579795 9289 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:35:02.579850 9288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:35:02.580060 9288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 02:35:02 dist-test-slave-7nm7 krb5kdc[9116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:02.582211 9288 catalog_manager.cc:1347] Generated new cluster ID: b1407e26ed7d4f9591bf1c9bbe1d5c42
I20260811 02:35:02.582298 9288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:35:02.585203 9259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:02.573696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56160 (local address 127.17.79.62:43119)
0811 02:35:02.573878 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:02.573885 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:02.573910 (+ 25us) server_negotiation.cc:407] Connection header received
0811 02:35:02.574429 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:02.574436 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:02.574485 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:02.574606 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:02.575501 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:02.576921 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:02.577789 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:02.578465 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:02.579022 (+ 557us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:02.581554 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:02.581557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:02.581558 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:02.581568 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:02.583564 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:02.583989 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:02.583992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:02.583992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:02.584089 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:02.584312 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:02.584313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:02.584313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:02.584586 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:02.584725 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:02.584873 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 02:35:02.584996 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260811 02:35:02.586264 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:35:02.601063 9288 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:35:02.601641 9288 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:35:02.609990 9288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d52cd4094801416ea1fa573df2ce55b5: Generated new TSK 0
I20260811 02:35:02.610199 9288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:35:02.640589 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 9141
2026-08-11T02:35:02Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1655 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:35:02 dist-test-slave-7nm7 krb5kdc[9299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:35:02 dist-test-slave-7nm7 krb5kdc[9299](info): set up 2 sockets
Aug 11 02:35:02 dist-test-slave-7nm7 krb5kdc[9299](info): commencing operation
krb5kdc: starting...
W20260811 02:35:03.948961 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:35:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:35:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:35:04.070816 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39339
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:39339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:04.174620 9322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:04.174957 9322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:04.175019 9322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:04.176290 9322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:35:04.176337 9322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:04.176354 9322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:04.176368 9322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:35:04.176383 9322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:35:04.178105 9322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:39339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:04.178440 9322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:04.178706 9322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:35:04.183809 9322 server_base.cc:1034] running on GCE node
W20260811 02:35:04.183741 9330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:04.183708 9333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:04.183743 9328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:04.184296 9322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:04.184604 9322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:04.185786 9322 hybrid_clock.cc:648] HybridClock initialized: now 1786415704185777 us; error 36 us; skew 500 ppm
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:04.188460 9322 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:35:04.188896 9322 webserver.cc:460] Webserver started at http://127.17.79.62:44241/ using document root <none> and password file <none>
I20260811 02:35:04.189157 9322 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:04.189229 9322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:04.189378 9322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:04.190541 9322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "e7b04dd901c61b963bbc345045b74ca1"
server_key_iv: "55796e4aa1881e960fc17e2cb6a942e3"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.190910 9322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "e7b04dd901c61b963bbc345045b74ca1"
server_key_iv: "55796e4aa1881e960fc17e2cb6a942e3"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.192298 9322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:35:04.193035 9348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.193216 9322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:35:04.193328 9322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "e7b04dd901c61b963bbc345045b74ca1"
server_key_iv: "55796e4aa1881e960fc17e2cb6a942e3"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.193403 9322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:04.204098 9322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:04.206503 9322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:04.206666 9322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:04.210820 9322 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:39339
I20260811 02:35:04.210863 9441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:39339 every 8 connection(s)
I20260811 02:35:04.211261 9322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:35:04.212393 9442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:04.214759 9442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Bootstrap starting.
I20260811 02:35:04.215304 9442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:04.215556 9442 log.cc:824] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:04.216266 9442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: No bootstrap required, opened a new log
I20260811 02:35:04.217223 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 9322
I20260811 02:35:04.217347 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:35:04.217571 17724 external_mini_cluster.cc:1428] Setting key cd9a67f32bec31bc11961e7a6f9d668b
I20260811 02:35:04.218560 9442 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:04.218736 9442 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:04.218777 9442 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee15af0bffa4941b1e9b39bddbe2f6b, State: Initialized, Role: FOLLOWER
I20260811 02:35:04.218968 9442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:04.219051 9442 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:35:04.219075 9442 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:35:04.219142 9442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:04.220407 9442 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:04.220522 9442 leader_election.cc:302] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ee15af0bffa4941b1e9b39bddbe2f6b; no voters:
I20260811 02:35:04.220682 9442 leader_election.cc:288] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:35:04.220801 9454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:35:04.220923 9442 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:35:04.220965 9454 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 LEADER]: Becoming Leader. State: Replica: 0ee15af0bffa4941b1e9b39bddbe2f6b, State: Running, Role: LEADER
I20260811 02:35:04.222301 9454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:04.222880 9456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ee15af0bffa4941b1e9b39bddbe2f6b. Latest consensus state: current_term: 1 leader_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } } }
I20260811 02:35:04.223174 9456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:04.222977 9458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } } }
I20260811 02:35:04.223378 9458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:04.223390 9478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:35:04.224033 9478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:04.226027 9478 catalog_manager.cc:1347] Generated new cluster ID: 4b820af7aa73476db61b77f3b5e6974a
I20260811 02:35:04.226105 9478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:35:04.229739 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.218102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54874 (local address 127.17.79.62:39339)
0811 02:35:04.218339 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.218349 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.218387 (+ 38us) server_negotiation.cc:407] Connection header received
0811 02:35:04.218507 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.218514 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.218570 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.218719 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:04.219530 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.221076 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.222156 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.222783 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.222904 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.225985 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:04.225989 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:04.225989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:04.226002 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:04.228041 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.228475 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.228478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.228478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.228602 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.228833 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.228833 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.228834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.229126 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:04.229273 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.229411 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.229544 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":97,"threads_started":1}
I20260811 02:35:04.240144 9478 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:35:04.240731 9478 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:35:04.245530 9478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Generated new TSK 0
I20260811 02:35:04.245733 9478 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:35:04.286342 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39339
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:04.373191 9493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:04.373462 9493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:04.373510 9493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:04.374858 9493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:04.374943 9493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:04.375005 9493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:35:04.376685 9493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:04.376986 9493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:04.377249 9493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:04.383071 9506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:04.383077 9504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:04.383141 9500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:04.383297 9493 server_base.cc:1034] running on GCE node
I20260811 02:35:04.383591 9493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:04.383805 9493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:04.384974 9493 hybrid_clock.cc:648] HybridClock initialized: now 1786415704384942 us; error 46 us; skew 500 ppm
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:04.387928 9493 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:35:04.388517 9493 webserver.cc:460] Webserver started at http://127.17.79.1:38229/ using document root <none> and password file <none>
I20260811 02:35:04.388804 9493 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:04.388856 9493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:04.388984 9493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:04.390110 9493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "ead970dd27e84810950f05928dedb360"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "6a6fb84817c9e4f494710dd6196458f8"
server_key_iv: "0ba5e9cb65099da198b0bba2c51cd64b"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.390667 9493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "ead970dd27e84810950f05928dedb360"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "6a6fb84817c9e4f494710dd6196458f8"
server_key_iv: "0ba5e9cb65099da198b0bba2c51cd64b"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.392097 9493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:04.392874 9521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.393065 9493 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:04.393162 9493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "ead970dd27e84810950f05928dedb360"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "6a6fb84817c9e4f494710dd6196458f8"
server_key_iv: "0ba5e9cb65099da198b0bba2c51cd64b"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.393231 9493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:04.407583 9493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:04.409937 9493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:04.410100 9493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:04.410408 9493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:04.410730 9493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:04.410789 9493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.410831 9493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:04.410880 9493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.416855 9493 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:33571
I20260811 02:35:04.416905 9723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:33571 every 8 connection(s)
I20260811 02:35:04.417238 9493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:35:04.422436 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 9493
I20260811 02:35:04.422595 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:35:04.422813 17724 external_mini_cluster.cc:1428] Setting key 404592623de3cedebe5b27fc334e72d2
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:04.427934 9728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.417944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:34729)
0811 02:35:04.418143 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:04.418181 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:04.418796 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:04.419001 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:04.419004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:04.419652 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:04.419863 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.419868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.420548 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.420549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.421523 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.421526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.421924 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.421925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.422025 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.422693 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:04.422702 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:04.424549 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:04.426583 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:04.426589 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:04.426591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:04.426811 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:04.427025 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:04.427026 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:04.427026 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:04.427141 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:04.427447 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:04.427453 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:04.427568 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 02:35:04.427659 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 02:35:04.427778 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
I20260811 02:35:04.427950 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.418002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:34729 (local address 127.17.79.62:39339)
0811 02:35:04.418101 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.418103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.418317 (+ 214us) server_negotiation.cc:407] Connection header received
0811 02:35:04.418882 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.418883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.418897 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.418951 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:04.419950 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.420458 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.421643 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.421849 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.421907 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.424642 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:04.424644 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:04.424644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:04.424653 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:04.426489 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.426892 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.426893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.426894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.426956 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.427210 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.427211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.427212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.427363 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:04.427435 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.427709 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.427807 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 02:35:04.428503 9725 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39339
I20260811 02:35:04.428608 9725 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:04.428813 9725 heartbeater.cc:511] Master 127.17.79.62:39339 requested a full tablet report, sending...
I20260811 02:35:04.429425 9386 ts_manager.cc:194] Registered new tserver with Master: ead970dd27e84810950f05928dedb360 (127.17.79.1:33571)
I20260811 02:35:04.430457 9386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:34729
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:35:04.451465 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39339
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:04.535780 9733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:04.535995 9733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:04.536019 9733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:04.537271 9733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:04.537320 9733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:04.537348 9733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:35:04.538839 9733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:04.539098 9733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:04.539352 9733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:04.544698 9745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:04.544795 9748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:04.544937 9733 server_base.cc:1034] running on GCE node
W20260811 02:35:04.544699 9746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:04.545248 9733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:04.545516 9733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:04.546697 9733 hybrid_clock.cc:648] HybridClock initialized: now 1786415704546690 us; error 38 us; skew 500 ppm
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:04.549388 9733 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:35:04.549831 9733 webserver.cc:460] Webserver started at http://127.17.79.2:38503/ using document root <none> and password file <none>
I20260811 02:35:04.550060 9733 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:04.550130 9733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:04.550318 9733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:04.551424 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "5d825f714b394c39b55eb16f95c29774"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "f9ba8d23046e828998e07eaf04f8469c"
server_key_iv: "770651e9b981825b394f02d3ff3e9225"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.551800 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "5d825f714b394c39b55eb16f95c29774"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "f9ba8d23046e828998e07eaf04f8469c"
server_key_iv: "770651e9b981825b394f02d3ff3e9225"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.553170 9733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:35:04.553946 9761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.554152 9733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:04.554284 9733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "5d825f714b394c39b55eb16f95c29774"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "f9ba8d23046e828998e07eaf04f8469c"
server_key_iv: "770651e9b981825b394f02d3ff3e9225"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.554392 9733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:04.590886 9733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:04.593253 9733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:04.593446 9733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:04.593740 9733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:04.594094 9733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:04.594152 9733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.594197 9733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:04.594223 9733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.601176 9733 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:42261
I20260811 02:35:04.601215 9956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:42261 every 8 connection(s)
I20260811 02:35:04.601565 9733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:35:04.607709 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 9733
I20260811 02:35:04.607803 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:35:04.607963 17724 external_mini_cluster.cc:1428] Setting key d390a7092e44a8a3b2ca54852ed26cb6
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:04.614013 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.602440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:46481 (local address 127.17.79.62:39339)
0811 02:35:04.602551 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.602553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.602722 (+ 169us) server_negotiation.cc:407] Connection header received
0811 02:35:04.603223 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.603224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.603235 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.603302 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:04.604332 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.604853 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.606111 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.606434 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.606499 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.609857 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:04.609859 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:04.609859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:04.609867 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:04.612147 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.612733 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.612734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.612735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.612801 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.613215 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.613216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.613217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.613378 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:04.613453 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.613765 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.613867 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:35:04.614034 9961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.602370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:46481)
0811 02:35:04.602548 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:04.602593 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:04.603088 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:04.603409 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:04.603413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:04.604014 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:04.604223 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.604227 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.605106 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.605108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.605998 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.606001 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.606536 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.606537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.606658 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.607263 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:04.607285 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:04.609724 (+ 2439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:04.612286 (+ 2562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:04.612299 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:04.612301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:04.612612 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:04.612899 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:04.612900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:04.612900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:04.613028 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:04.613456 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:04.613463 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:04.613617 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 02:35:04.613723 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 02:35:04.613863 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260811 02:35:04.614848 9958 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39339
I20260811 02:35:04.614945 9958 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:04.615257 9958 heartbeater.cc:511] Master 127.17.79.62:39339 requested a full tablet report, sending...
I20260811 02:35:04.615883 9386 ts_manager.cc:194] Registered new tserver with Master: 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
I20260811 02:35:04.616556 9386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:46481
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:35:04.641973 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39339
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:04.726933 9965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:04.727144 9965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:04.727170 9965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:04.728322 9965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:04.728372 9965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:04.728399 9965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:35:04.729817 9965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:04.730085 9965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:04.730377 9965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:04.735913 9980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:04.735986 9974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:04.735926 9973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:04.736442 9965 server_base.cc:1034] running on GCE node
I20260811 02:35:04.736687 9965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:04.736989 9965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:04.738189 9965 hybrid_clock.cc:648] HybridClock initialized: now 1786415704738149 us; error 68 us; skew 500 ppm
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:04.740923 9965 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:35:04.741525 9965 webserver.cc:460] Webserver started at http://127.17.79.3:45597/ using document root <none> and password file <none>
I20260811 02:35:04.741817 9965 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:04.741894 9965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:04.742048 9965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:04.743207 9965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "68f1836918b04ee0993fbc332b941f9d"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "8e958d521dc34144ef2545cf30afee54"
server_key_iv: "d88d623b6c574d68f2f8dea13e6bfbd2"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.743585 9965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "68f1836918b04ee0993fbc332b941f9d"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "8e958d521dc34144ef2545cf30afee54"
server_key_iv: "d88d623b6c574d68f2f8dea13e6bfbd2"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.744952 9965 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 02:35:04.745838 9989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.746026 9965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:04.746140 9965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "68f1836918b04ee0993fbc332b941f9d"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "8e958d521dc34144ef2545cf30afee54"
server_key_iv: "d88d623b6c574d68f2f8dea13e6bfbd2"
server_key_version: "encryptionkey@0"
I20260811 02:35:04.746234 9965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:04.767941 9965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:04.769922 9965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:04.770097 9965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:04.770377 9965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:04.770711 9965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:04.770773 9965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.770816 9965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:04.770859 9965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:04.776593 9965 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:41969
I20260811 02:35:04.776638 10203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:41969 every 8 connection(s)
I20260811 02:35:04.776950 9965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:35:04.778128 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 9965
I20260811 02:35:04.778211 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:35:04.778416 17724 external_mini_cluster.cc:1428] Setting key a4bfa77837e96b6ec50f6fe51a85c47e
Aug 11 02:35:04 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415704, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:04.786540 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.777705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:46439 (local address 127.17.79.62:39339)
0811 02:35:04.777759 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.777761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.777952 (+ 191us) server_negotiation.cc:407] Connection header received
0811 02:35:04.778708 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.778710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.778722 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.778778 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:04.779887 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.780389 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.781438 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.781649 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.781734 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.783918 (+ 2184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:04.783919 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:04.783919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:04.783927 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:04.785129 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.785537 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.785538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.785539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.785602 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.785853 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.785855 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.785855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.785974 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:04.786052 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.786360 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.786438 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:35:04.786718 10211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.777650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:46439)
0811 02:35:04.777814 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:04.777856 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:04.778587 (+ 731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:04.778848 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:04.778852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:04.779602 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:04.779791 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.779796 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.780488 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.780489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.781326 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.781328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.781745 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.781746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.781877 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.782460 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:04.782468 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:04.783821 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:04.785227 (+ 1406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:04.785234 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:04.785236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:04.785453 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:04.785673 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:04.785674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:04.785675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:04.785780 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:04.786058 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:04.786064 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:04.786198 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 02:35:04.786336 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 02:35:04.786489 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260811 02:35:04.787195 10207 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39339
I20260811 02:35:04.787289 10207 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:04.787420 10207 heartbeater.cc:511] Master 127.17.79.62:39339 requested a full tablet report, sending...
I20260811 02:35:04.787781 9386 ts_manager.cc:194] Registered new tserver with Master: 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969)
I20260811 02:35:04.788111 9386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:46439
I20260811 02:35:04.790048 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:35:04.797353 9449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.791505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54884 (local address 127.17.79.62:39339)
0811 02:35:04.791560 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.791561 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.791628 (+ 67us) server_negotiation.cc:407] Connection header received
0811 02:35:04.791675 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.791675 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.791683 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.791738 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:04.792266 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.792715 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.793410 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.793587 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.793644 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.794755 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:04.794756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:04.794757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:04.794762 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:04.796104 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.796431 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.796432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.796432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.796482 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:04.796779 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:04.796780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:04.796780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:04.796910 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:04.796985 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.797196 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.797293 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 02:35:04.798854 9386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54884:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:35:04.800381 9386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:35:04.806763 10229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.802650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:42261 (local address 127.0.0.1:54702)
0811 02:35:04.803042 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:04.803052 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:04.803096 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:04.803307 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:04.803310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:04.803312 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:04.803387 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.803389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.804315 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.804317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.805477 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.805480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.806419 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.806420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.806507 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.806521 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 02:35:04.806604 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 02:35:04.806678 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":55,"threads_started":1}
I20260811 02:35:04.806772 10236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.802892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54702 (local address 127.17.79.2:42261)
0811 02:35:04.803080 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.803084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.803096 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:35:04.803200 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.803204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.803221 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.803298 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:04.803470 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.804211 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.805584 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.806323 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.806397 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.806451 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.806633 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.806676 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260811 02:35:04.807159 10230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.802648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33571 (local address 127.0.0.1:42186)
0811 02:35:04.802815 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:04.802870 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:04.802938 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:04.803528 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:04.803529 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:04.803531 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:04.803573 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.803575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.804834 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.804835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.805942 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.805945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.806979 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.806981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.807046 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.807049 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:35:04.807078 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 02:35:04.807116 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":19,"thread_start_us":96,"threads_started":1}
I20260811 02:35:04.807390 10228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.802661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:41969 (local address 127.0.0.1:37782)
0811 02:35:04.803086 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:04.803096 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:04.803170 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:04.803415 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:04.803417 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:04.803420 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:04.803472 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.803475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.804760 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.804761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.805866 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:04.805869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.806874 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.806875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:04.806946 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.806950 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:35:04.807107 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 02:35:04.807156 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":33,"thread_start_us":88,"threads_started":1}
I20260811 02:35:04.807574 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.802767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42186 (local address 127.17.79.1:33571)
0811 02:35:04.803229 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.803243 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.803252 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:35:04.803291 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.803293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.803427 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.803649 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:04.803721 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.804762 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.806073 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.806863 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.807368 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.807435 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.807463 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.807501 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":122,"threads_started":1}
I20260811 02:35:04.807685 9855 tablet_service.cc:1467] Processing CreateTablet for tablet 15c6accddf17421bb35ddbaf4671ed49 (DEFAULT_TABLE table=test-table [id=242737cdf9904a5fa59012c8fac44a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:04.808106 9855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15c6accddf17421bb35ddbaf4671ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:04.808233 9610 tablet_service.cc:1467] Processing CreateTablet for tablet 15c6accddf17421bb35ddbaf4671ed49 (DEFAULT_TABLE table=test-table [id=242737cdf9904a5fa59012c8fac44a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:04.808571 9610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15c6accddf17421bb35ddbaf4671ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:04.810685 10238 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Bootstrap starting.
I20260811 02:35:04.810741 10234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:04.802872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37782 (local address 127.17.79.3:41969)
0811 02:35:04.803183 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:04.803188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:04.803197 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:35:04.803236 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:04.803238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:04.803254 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:04.803333 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:04.803554 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.804639 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.805957 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:04.806715 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:04.806783 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:04.806834 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:04.807200 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 02:35:04.810653 (+ 3453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":116,"threads_started":1}
I20260811 02:35:04.811194 10239 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Bootstrap starting.
I20260811 02:35:04.811368 10087 tablet_service.cc:1467] Processing CreateTablet for tablet 15c6accddf17421bb35ddbaf4671ed49 (DEFAULT_TABLE table=test-table [id=242737cdf9904a5fa59012c8fac44a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:04.811717 10087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15c6accddf17421bb35ddbaf4671ed49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:04.811789 10238 tablet_bootstrap.cc:654] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:04.811868 10239 tablet_bootstrap.cc:654] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:04.812312 10238 log.cc:824] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:04.812464 10239 log.cc:824] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:04.813237 10239 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: No bootstrap required, opened a new log
I20260811 02:35:04.813246 10238 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: No bootstrap required, opened a new log
I20260811 02:35:04.813318 10238 ts_tablet_manager.cc:1397] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:35:04.813318 10239 ts_tablet_manager.cc:1397] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:04.814818 10245 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Bootstrap starting.
I20260811 02:35:04.815423 10245 tablet_bootstrap.cc:654] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:04.815349 10239 raft_consensus.cc:348] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:04.815349 10238 raft_consensus.cc:348] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:04.815521 10238 raft_consensus.cc:374] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:04.815515 10239 raft_consensus.cc:374] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:04.815562 10238 raft_consensus.cc:729] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d825f714b394c39b55eb16f95c29774, State: Initialized, Role: FOLLOWER
I20260811 02:35:04.815562 10239 raft_consensus.cc:729] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead970dd27e84810950f05928dedb360, State: Initialized, Role: FOLLOWER
I20260811 02:35:04.815694 10238 consensus_queue.cc:260] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:04.815676 10239 consensus_queue.cc:260] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:04.815991 10238 ts_tablet_manager.cc:1428] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:35:04.816004 9725 heartbeater.cc:503] Master 127.17.79.62:39339 was elected leader, sending a full tablet report...
I20260811 02:35:04.816042 10245 log.cc:824] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:04.816118 9958 heartbeater.cc:503] Master 127.17.79.62:39339 was elected leader, sending a full tablet report...
I20260811 02:35:04.815991 10239 ts_tablet_manager.cc:1428] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:35:04.816928 10245 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: No bootstrap required, opened a new log
I20260811 02:35:04.817004 10245 ts_tablet_manager.cc:1397] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:35:04.818478 10245 raft_consensus.cc:348] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:04.818598 10245 raft_consensus.cc:374] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:04.818655 10245 raft_consensus.cc:729] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f1836918b04ee0993fbc332b941f9d, State: Initialized, Role: FOLLOWER
I20260811 02:35:04.818770 10245 consensus_queue.cc:260] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:04.818998 10245 ts_tablet_manager.cc:1428] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:04.819092 10207 heartbeater.cc:503] Master 127.17.79.62:39339 was elected leader, sending a full tablet report...
W20260811 02:35:04.852240 9960 tablet.cc:2369] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:35:04.918107 9727 tablet.cc:2369] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:35:05.027514 10210 tablet.cc:2369] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:35:05.090690 10246 raft_consensus.cc:482] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:05.090866 10246 raft_consensus.cc:504] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:05.091342 10246 leader_election.cc:288] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ead970dd27e84810950f05928dedb360 (127.17.79.1:33571), 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969)
I20260811 02:35:05.094274 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.091715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:36207 (local address 127.17.79.1:33571)
0811 02:35:05.091779 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.091782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.091792 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:35:05.091827 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.091827 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.091852 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.091938 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:05.092123 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.092590 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.093529 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.093897 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.093983 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.093994 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.094156 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.094191 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 02:35:05.094273 9961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.091589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33571 (local address 127.17.79.2:36207)
0811 02:35:05.091671 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.091691 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.091765 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.091946 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.091947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.091949 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:05.092025 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.092027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.092675 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.092676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.093433 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.093435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.093983 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.093984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.094071 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.094074 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.094138 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.094179 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 02:35:05.094378 10234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.091680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:45503 (local address 127.17.79.3:41969)
0811 02:35:05.091745 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.091747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.091929 (+ 182us) server_negotiation.cc:407] Connection header received
0811 02:35:05.091992 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.091993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.092004 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.092075 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:05.092232 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.092692 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.093620 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.093997 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.094077 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.094088 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.094264 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.094307 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:35:05.094393 10255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.091594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:41969 (local address 127.17.79.2:45503)
0811 02:35:05.091866 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.091873 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.091931 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.092078 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.092080 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.092081 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:05.092154 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.092155 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.092776 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.092777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.093527 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.093529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.094091 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.094092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.094169 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.094173 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.094280 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.094315 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":116,"thread_start_us":89,"threads_started":1}
I20260811 02:35:05.094667 9646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15c6accddf17421bb35ddbaf4671ed49" candidate_uuid: "5d825f714b394c39b55eb16f95c29774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead970dd27e84810950f05928dedb360" is_pre_election: true
I20260811 02:35:05.094861 9646 raft_consensus.cc:2454] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d825f714b394c39b55eb16f95c29774 in term 0.
I20260811 02:35:05.094822 10126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15c6accddf17421bb35ddbaf4671ed49" candidate_uuid: "5d825f714b394c39b55eb16f95c29774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f1836918b04ee0993fbc332b941f9d" is_pre_election: true
I20260811 02:35:05.094954 10126 raft_consensus.cc:2454] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d825f714b394c39b55eb16f95c29774 in term 0.
I20260811 02:35:05.095095 9762 leader_election.cc:302] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d825f714b394c39b55eb16f95c29774, ead970dd27e84810950f05928dedb360; no voters:
I20260811 02:35:05.095258 10246 raft_consensus.cc:2781] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:35:05.095345 10246 raft_consensus.cc:482] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:35:05.095384 10246 raft_consensus.cc:3037] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:05.096212 10246 raft_consensus.cc:504] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:05.096366 10246 leader_election.cc:288] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [CANDIDATE]: Term 1 election: Requested vote from peers ead970dd27e84810950f05928dedb360 (127.17.79.1:33571), 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969)
I20260811 02:35:05.096549 10126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15c6accddf17421bb35ddbaf4671ed49" candidate_uuid: "5d825f714b394c39b55eb16f95c29774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f1836918b04ee0993fbc332b941f9d"
I20260811 02:35:05.096580 9646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15c6accddf17421bb35ddbaf4671ed49" candidate_uuid: "5d825f714b394c39b55eb16f95c29774" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ead970dd27e84810950f05928dedb360"
I20260811 02:35:05.096659 9646 raft_consensus.cc:3037] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:05.096665 10126 raft_consensus.cc:3037] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:05.097466 9646 raft_consensus.cc:2454] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d825f714b394c39b55eb16f95c29774 in term 1.
I20260811 02:35:05.097641 9762 leader_election.cc:302] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d825f714b394c39b55eb16f95c29774, ead970dd27e84810950f05928dedb360; no voters:
I20260811 02:35:05.097668 10126 raft_consensus.cc:2454] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d825f714b394c39b55eb16f95c29774 in term 1.
I20260811 02:35:05.097743 10246 raft_consensus.cc:2781] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:35:05.097905 10246 raft_consensus.cc:686] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 1 LEADER]: Becoming Leader. State: Replica: 5d825f714b394c39b55eb16f95c29774, State: Running, Role: LEADER
I20260811 02:35:05.098007 10246 consensus_queue.cc:237] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:05.098912 9386 catalog_manager.cc:5495] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d825f714b394c39b55eb16f95c29774 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "5d825f714b394c39b55eb16f95c29774" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260811 02:35:05.160738 10236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.158320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54714 (local address 127.17.79.2:42261)
0811 02:35:05.158399 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.158402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.158412 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:35:05.158460 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.158461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.158483 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.158562 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:35:05.158722 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.159180 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.159932 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.160124 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.160213 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.160387 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:35:05.160483 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:35:05.160577 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.160596 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.160615 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 02:35:05.162627 9646 raft_consensus.cc:1261] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Refusing update from remote peer 5d825f714b394c39b55eb16f95c29774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:05.162922 10126 raft_consensus.cc:1261] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Refusing update from remote peer 5d825f714b394c39b55eb16f95c29774: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:05.162966 10246 consensus_queue.cc:1035] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:05.163273 10246 consensus_queue.cc:1035] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:05.166463 10273 mvcc.cc:205] Tried to move back new op lower bound from 7317158728343146496 to 7317158728082083840. Current Snapshot: MvccSnapshot[applied={T|T < 7317158728343146496}]
I20260811 02:35:05.167479 9386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:05.167598 9386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54884:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:05.168359 9386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Sending DeleteTablet for 3 replicas of tablet 15c6accddf17421bb35ddbaf4671ed49
I20260811 02:35:05.168699 10087 tablet_service.cc:1514] Processing DeleteTablet for tablet 15c6accddf17421bb35ddbaf4671ed49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:05 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:37782
I20260811 02:35:05.168687 9855 tablet_service.cc:1514] Processing DeleteTablet for tablet 15c6accddf17421bb35ddbaf4671ed49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:05 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:54702
I20260811 02:35:05.168910 10291 tablet_replica.cc:330] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: stopping tablet replica
I20260811 02:35:05.169008 10291 raft_consensus.cc:2229] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:35:05.169064 9610 tablet_service.cc:1514] Processing DeleteTablet for tablet 15c6accddf17421bb35ddbaf4671ed49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:05 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:42186
I20260811 02:35:05.169116 10291 raft_consensus.cc:2258] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:05.169353 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 9493
I20260811 02:35:05.172441 10291 ts_tablet_manager.cc:1905] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:05.175645 10291 ts_tablet_manager.cc:1918] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:05.175733 10291 log.cc:1196] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/15c6accddf17421bb35ddbaf4671ed49
I20260811 02:35:05.176081 10291 ts_tablet_manager.cc:1939] T 15c6accddf17421bb35ddbaf4671ed49 P 5d825f714b394c39b55eb16f95c29774: Deleting consensus metadata
I20260811 02:35:05.176604 9357 catalog_manager.cc:4841] TS 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261): tablet 15c6accddf17421bb35ddbaf4671ed49 (table test-table [id=242737cdf9904a5fa59012c8fac44a32]) successfully deleted
I20260811 02:35:05.182255 10289 tablet_replica.cc:330] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: stopping tablet replica
I20260811 02:35:05.182384 10289 raft_consensus.cc:2229] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:05.182507 10289 raft_consensus.cc:2258] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:05.183050 10289 ts_tablet_manager.cc:1905] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:05.185264 10289 ts_tablet_manager.cc:1918] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:05.185346 10289 log.cc:1196] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/15c6accddf17421bb35ddbaf4671ed49
I20260811 02:35:05.185633 10289 ts_tablet_manager.cc:1939] T 15c6accddf17421bb35ddbaf4671ed49 P 68f1836918b04ee0993fbc332b941f9d: Deleting consensus metadata
I20260811 02:35:05.186095 9358 catalog_manager.cc:4841] TS 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969): tablet 15c6accddf17421bb35ddbaf4671ed49 (table test-table [id=242737cdf9904a5fa59012c8fac44a32]) successfully deleted
W20260811 02:35:05.189229 9356 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:33571 (error 108)
I20260811 02:35:05.189803 10228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.189654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33571 (local address 127.0.0.1:42190)
0811 02:35:05.189721 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.189762 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 02:35:05.189893 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 9733
W20260811 02:35:05.189952 9356 catalog_manager.cc:4584] TS ead970dd27e84810950f05928dedb360 (127.17.79.1:33571): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 15c6accddf17421bb35ddbaf4671ed49: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33571: connect: Connection refused (error 111)
I20260811 02:35:05.201432 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 9965
I20260811 02:35:05.214136 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 9322
I20260811 02:35:05.228935 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39339
--webserver_interface=127.17.79.62
--webserver_port=44241
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:39339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:05.316138 10297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:05.316354 10297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:05.316376 10297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:05.317682 10297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:35:05.317739 10297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:05.317756 10297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:05.317771 10297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:35:05.317785 10297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:35:05.319440 10297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:39339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=44241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:05.319708 10297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:05.319959 10297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:05.329388 10308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:05.329442 10297 server_base.cc:1034] running on GCE node
W20260811 02:35:05.329468 10307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:05.329385 10313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:05.329905 10297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:05.330291 10297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:05.331497 10297 hybrid_clock.cc:648] HybridClock initialized: now 1786415705331476 us; error 38 us; skew 500 ppm
Aug 11 02:35:05 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:05.334044 10297 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:35:05.334566 10297 webserver.cc:460] Webserver started at http://127.17.79.62:44241/ using document root <none> and password file <none>
I20260811 02:35:05.334808 10297 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:05.334894 10297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:05.336277 10297 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:05.336931 10323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.337105 10297 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:35:05.337221 10297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "e7b04dd901c61b963bbc345045b74ca1"
server_key_iv: "55796e4aa1881e960fc17e2cb6a942e3"
server_key_version: "encryptionkey@0"
I20260811 02:35:05.337610 10297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:05.357504 10297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:05.359735 10297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:05.359910 10297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:05.364254 10297 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:39339
I20260811 02:35:05.364307 10413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:39339 every 8 connection(s)
I20260811 02:35:05.364714 10297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:35:05.366510 10416 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:35:05.367161 10416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Bootstrap starting.
I20260811 02:35:05.374702 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 10297
I20260811 02:35:05.375046 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:33571
--local_ip_for_outbound_sockets=127.17.79.1
--tserver_master_addrs=127.17.79.62:39339
--webserver_port=38229
--webserver_interface=127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:35:05.375840 10416 log.cc:824] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:05.377978 10416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:35:05.378374 10416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Bootstrap complete.
I20260811 02:35:05.380772 10416 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:05.381026 10416 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee15af0bffa4941b1e9b39bddbe2f6b, State: Initialized, Role: FOLLOWER
I20260811 02:35:05.381214 10416 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:05.381296 10416 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:35:05.381354 10416 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:35:05.381402 10416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 1 FOLLOWER]: Advancing to term 2
I20260811 02:35:05.382477 10416 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:05.382606 10416 leader_election.cc:302] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ee15af0bffa4941b1e9b39bddbe2f6b; no voters:
I20260811 02:35:05.382809 10416 leader_election.cc:288] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 02:35:05.382846 10425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 FOLLOWER]: Leader election won for term 2
I20260811 02:35:05.382956 10425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 LEADER]: Becoming Leader. State: Replica: 0ee15af0bffa4941b1e9b39bddbe2f6b, State: Running, Role: LEADER
I20260811 02:35:05.383071 10425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:05.383119 10416 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:35:05.383352 10427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ee15af0bffa4941b1e9b39bddbe2f6b. Latest consensus state: current_term: 2 leader_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } } }
I20260811 02:35:05.383461 10427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:05.383644 10426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } } }
I20260811 02:35:05.383715 10426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:05.383833 10430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:35:05.384722 10430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:35:05.384857 10430 catalog_manager.cc:1259] Loaded cluster ID: 4b820af7aa73476db61b77f3b5e6974a
I20260811 02:35:05.384896 10430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:35:05.385437 10430 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 02:35:05.390611 10430 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 02:35:05.393240 10430 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:35:05.393452 10430 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Loaded TSK: 0
I20260811 02:35:05.393702 10430 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 02:35:05.466312 10421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:05.466517 10421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:05.466542 10421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:05.467700 10421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:05.467743 10421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:05.467770 10421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:35:05.469266 10421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:33571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=38229
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:05.469528 10421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:05.469765 10421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:05.474794 10457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:05.474789 10460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:05.474795 10458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:05.475203 10421 server_base.cc:1034] running on GCE node
I20260811 02:35:05.475421 10421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:05.475689 10421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:05.476867 10421 hybrid_clock.cc:648] HybridClock initialized: now 1786415705476850 us; error 32 us; skew 500 ppm
Aug 11 02:35:05 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:05.479502 10421 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:35:05.480013 10421 webserver.cc:460] Webserver started at http://127.17.79.1:38229/ using document root <none> and password file <none>
I20260811 02:35:05.480257 10421 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:05.480315 10421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:05.481716 10421 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:05.482445 10470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.482661 10421 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:05.482769 10421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "ead970dd27e84810950f05928dedb360"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "6a6fb84817c9e4f494710dd6196458f8"
server_key_iv: "0ba5e9cb65099da198b0bba2c51cd64b"
server_key_version: "encryptionkey@0"
I20260811 02:35:05.483126 10421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:05.501543 10421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:05.503890 10421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:05.504091 10421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:05.504384 10421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:05.504916 10484 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 02:35:05.506500 10421 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 02:35:05.506561 10421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 02:35:05.506590 10421 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 02:35:05.507433 10421 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 02:35:05.507483 10421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:05.507552 10484 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Bootstrap starting.
I20260811 02:35:05.516181 10421 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:33571
I20260811 02:35:05.516232 10685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:33571 every 8 connection(s)
I20260811 02:35:05.516705 10421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:35:05.519239 10484 log.cc:824] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:05.521744 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 10421
I20260811 02:35:05.521778 10484 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:35:05.522045 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:42261
--local_ip_for_outbound_sockets=127.17.79.2
--tserver_master_addrs=127.17.79.62:39339
--webserver_port=38503
--webserver_interface=127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:35:05.522114 10484 tablet_bootstrap.cc:492] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Bootstrap complete.
I20260811 02:35:05.523403 10484 ts_tablet_manager.cc:1397] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.006s
Aug 11 02:35:05 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:05.524982 10484 raft_consensus.cc:348] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:05.525333 10484 raft_consensus.cc:729] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead970dd27e84810950f05928dedb360, State: Initialized, Role: FOLLOWER
I20260811 02:35:05.525484 10484 consensus_queue.cc:260] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } } peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } }
I20260811 02:35:05.525796 10484 ts_tablet_manager.cc:1428] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
I20260811 02:35:05.528832 10697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.517761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:44351 (local address 127.17.79.62:39339)
0811 02:35:05.518401 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.518411 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.518457 (+ 46us) server_negotiation.cc:407] Connection header received
0811 02:35:05.518592 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.518596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.518636 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.518777 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:05.519461 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.520427 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.521889 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.522583 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.522704 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.525248 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:05.525258 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:05.525259 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:05.525268 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:05.527028 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.527529 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.527532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.527532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.527624 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.527888 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.527889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.527889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.528102 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:05.528230 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.528525 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.528649 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":74,"threads_started":1}
I20260811 02:35:05.528832 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.517441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:44351)
0811 02:35:05.517786 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.517836 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.518400 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.518806 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.518810 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.519103 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:05.519284 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.519288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.520572 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.520574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.521758 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.521761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.522728 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.522730 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.522879 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.523588 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:05.523598 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:05.525126 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:05.527132 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:05.527140 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:05.527142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:05.527424 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:05.527704 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:05.527705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:05.527705 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:05.527817 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:05.528211 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:05.528218 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:05.528353 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.528456 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.528629 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":94,"threads_started":1}
I20260811 02:35:05.529485 10689 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39339
I20260811 02:35:05.529578 10689 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:05.529759 10689 heartbeater.cc:511] Master 127.17.79.62:39339 requested a full tablet report, sending...
I20260811 02:35:05.530500 10347 ts_manager.cc:194] Registered new tserver with Master: ead970dd27e84810950f05928dedb360 (127.17.79.1:33571)
I20260811 02:35:05.531603 10347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:44351
I20260811 02:35:05.532446 10689 heartbeater.cc:503] Master 127.17.79.62:39339 was elected leader, sending a full tablet report...
I20260811 02:35:05.537889 10704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.531072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33571 (local address 127.0.0.1:42202)
0811 02:35:05.531277 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.531306 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.531361 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.534589 (+ 3228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.534592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.534594 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:05.534646 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.534648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.535932 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.535933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.536740 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.536742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.537633 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.537634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.537703 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.537714 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.537786 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.537829 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":93,"threads_started":1}
I20260811 02:35:05.537920 10705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.531176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42202 (local address 127.17.79.1:33571)
0811 02:35:05.534354 (+ 3178us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.534359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.534372 (+ 13us) server_negotiation.cc:407] Connection header received
0811 02:35:05.534409 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.534411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.534429 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.534537 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:05.534739 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.535844 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.536823 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.537517 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.537602 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.537653 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.537811 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.537851 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3142,"thread_start_us":84,"threads_started":1}
I20260811 02:35:05.538550 10552 tablet_service.cc:1514] Processing DeleteTablet for tablet 15c6accddf17421bb35ddbaf4671ed49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:05 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:42202
I20260811 02:35:05.539122 10706 tablet_replica.cc:330] stopping tablet replica
I20260811 02:35:05.539238 10706 raft_consensus.cc:2229] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:05.539314 10706 raft_consensus.cc:2258] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:05.539621 10706 ts_tablet_manager.cc:1905] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:05.541738 10706 ts_tablet_manager.cc:1918] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:05.541807 10706 log.cc:1196] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/15c6accddf17421bb35ddbaf4671ed49
I20260811 02:35:05.542084 10706 ts_tablet_manager.cc:1939] T 15c6accddf17421bb35ddbaf4671ed49 P ead970dd27e84810950f05928dedb360: Deleting consensus metadata
I20260811 02:35:05.542822 10324 catalog_manager.cc:4841] TS ead970dd27e84810950f05928dedb360 (127.17.79.1:33571): tablet 15c6accddf17421bb35ddbaf4671ed49 (table test-table [id=242737cdf9904a5fa59012c8fac44a32]) successfully deleted
W20260811 02:35:05.608364 10701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:05.608603 10701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:05.608641 10701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:05.609750 10701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:05.609818 10701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:05.609863 10701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:35:05.611353 10701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:42261
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=38503
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:05.611631 10701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:05.611876 10701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:05.616964 10713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:05.617014 10722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:05.617148 10701 server_base.cc:1034] running on GCE node
W20260811 02:35:05.616981 10712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:05.617451 10701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:05.617750 10701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:05.618928 10701 hybrid_clock.cc:648] HybridClock initialized: now 1786415705618905 us; error 40 us; skew 500 ppm
Aug 11 02:35:05 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:05.621407 10701 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:35:05.621801 10701 webserver.cc:460] Webserver started at http://127.17.79.2:38503/ using document root <none> and password file <none>
I20260811 02:35:05.622007 10701 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:05.622058 10701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:05.623426 10701 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:05.624014 10735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.624257 10701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:05.624380 10701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "5d825f714b394c39b55eb16f95c29774"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "f9ba8d23046e828998e07eaf04f8469c"
server_key_iv: "770651e9b981825b394f02d3ff3e9225"
server_key_version: "encryptionkey@0"
I20260811 02:35:05.624723 10701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:05.647032 10701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:05.649268 10701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:05.649457 10701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:05.649714 10701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:05.650043 10701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:05.650098 10701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.650141 10701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:05.650195 10701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.656052 10701 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:42261
I20260811 02:35:05.656145 10919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:42261 every 8 connection(s)
I20260811 02:35:05.656498 10701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:35:05.659309 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 10701
I20260811 02:35:05.659580 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:41969
--local_ip_for_outbound_sockets=127.17.79.3
--tserver_master_addrs=127.17.79.62:39339
--webserver_port=45597
--webserver_interface=127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 02:35:05 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:05.667400 10697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.657296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:42201 (local address 127.17.79.62:39339)
0811 02:35:05.657369 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.657371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.657600 (+ 229us) server_negotiation.cc:407] Connection header received
0811 02:35:05.658273 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.658274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.658291 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.658355 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:05.659338 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.660010 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.661021 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.661371 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.661443 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.664136 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:05.664138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:05.664138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:05.664149 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:05.665819 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.666350 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.666352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.666353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.666416 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.666706 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.666707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.666708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.666833 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:05.666911 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.667207 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.667305 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 02:35:05.667621 10925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.657275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:42201)
0811 02:35:05.657465 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.657505 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.658019 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.658424 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.658428 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.659013 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:05.659232 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.659236 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.660119 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.660120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.660923 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.660925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.661520 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.661521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.661690 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.662277 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:05.662288 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:05.663999 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:05.665969 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:05.665976 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:05.665979 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:05.666282 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:05.666488 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:05.666489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:05.666489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:05.666618 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:05.666902 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:05.666909 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:05.667063 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.667174 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.667355 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260811 02:35:05.668102 10923 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39339
I20260811 02:35:05.668231 10923 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:05.668416 10923 heartbeater.cc:511] Master 127.17.79.62:39339 requested a full tablet report, sending...
I20260811 02:35:05.668859 10347 ts_manager.cc:194] Registered new tserver with Master: 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
I20260811 02:35:05.669239 10347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:42201
W20260811 02:35:05.747570 10926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:05.747784 10926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:05.747807 10926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:05.748960 10926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:05.749003 10926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:05.749030 10926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:35:05.750540 10926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:41969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=45597
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:05.750787 10926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:05.751027 10926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:05.756242 10939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:05.756266 10950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:05.756240 10941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:05.756556 10926 server_base.cc:1034] running on GCE node
I20260811 02:35:05.756745 10926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:05.756994 10926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:05.758181 10926 hybrid_clock.cc:648] HybridClock initialized: now 1786415705758161 us; error 34 us; skew 500 ppm
Aug 11 02:35:05 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:05.760845 10926 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:35:05.761317 10926 webserver.cc:460] Webserver started at http://127.17.79.3:45597/ using document root <none> and password file <none>
I20260811 02:35:05.761588 10926 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:05.761678 10926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:05.763213 10926 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:05.763926 10960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.764195 10926 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:05.764333 10926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "68f1836918b04ee0993fbc332b941f9d"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "8e958d521dc34144ef2545cf30afee54"
server_key_iv: "d88d623b6c574d68f2f8dea13e6bfbd2"
server_key_version: "encryptionkey@0"
I20260811 02:35:05.764693 10926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:05.777854 10926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:05.780369 10926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:05.780558 10926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:05.780815 10926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:05.781162 10926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:05.781246 10926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.781289 10926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:05.781334 10926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:05.788100 10926 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:41969
I20260811 02:35:05.788152 11147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:41969 every 8 connection(s)
I20260811 02:35:05.788532 10926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
Aug 11 02:35:05 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:05.796386 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 10926
I20260811 02:35:05.798211 10697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.789279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:47533 (local address 127.17.79.62:39339)
0811 02:35:05.789350 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.789352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.789567 (+ 215us) server_negotiation.cc:407] Connection header received
0811 02:35:05.790204 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.790205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.790219 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.790299 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:05.791352 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.791948 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.792930 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.793129 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.793217 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.795302 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:05.795305 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:05.795305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:05.795312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:05.796541 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.797083 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.797085 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.797085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.797179 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.797476 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.797477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.797477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.797585 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:05.797641 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.797997 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.798114 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:35:05.798295 11153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.789263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:47533)
0811 02:35:05.789444 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.789480 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.790057 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.790369 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.790373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.791013 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:05.791254 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.791259 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.792043 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.792044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.792835 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.792837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.793228 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.793229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.793350 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.793821 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:05.793829 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:05.795204 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:05.796641 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:05.796649 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:05.796651 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:05.796994 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:05.797253 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:05.797254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:05.797255 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:05.797399 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:05.797657 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:05.797665 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:05.797833 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.797951 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.798076 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260811 02:35:05.798808 11149 heartbeater.cc:347] Connected to a master server at 127.17.79.62:39339
I20260811 02:35:05.798899 11149 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:05.799104 11149 heartbeater.cc:511] Master 127.17.79.62:39339 requested a full tablet report, sending...
I20260811 02:35:05.799535 10347 ts_manager.cc:194] Registered new tserver with Master: 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969)
I20260811 02:35:05.799940 10347 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:47533
I20260811 02:35:05.803438 11155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.796830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54890 (local address 127.17.79.62:39339)
0811 02:35:05.796935 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.796937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.796994 (+ 57us) server_negotiation.cc:407] Connection header received
0811 02:35:05.797075 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.797076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.797088 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.797170 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:05.797889 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.798663 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.799657 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.799857 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.799913 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.801223 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:05.801225 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:05.801225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:05.801231 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:05.802545 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.802851 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.802851 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.802851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.802896 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:05.803040 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:05.803041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:05.803041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:05.803137 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:05.803257 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.803292 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.803350 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":64,"threads_started":1}
I20260811 02:35:05.804240 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:35:05.807020 11155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.804632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54906 (local address 127.17.79.62:39339)
0811 02:35:05.804678 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.804680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.804724 (+ 44us) server_negotiation.cc:407] Connection header received
0811 02:35:05.804813 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.804814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.804852 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.804937 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:35:05.805035 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.805481 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.806214 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.806450 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.806537 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.806714 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:35:05.806815 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:35:05.806907 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.806929 (+ 22us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.806950 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:35:05.807309 10347 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:35:05.808954 10347 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:35:05.811067 10552 tablet_service.cc:1467] Processing CreateTablet for tablet ca1e17fa8889406190242392ab0ccd7c (DEFAULT_TABLE table=test-table [id=4d700db1e25e4e82bb5aebd36182bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:05.811280 10552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1e17fa8889406190242392ab0ccd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:05.812939 10484 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Bootstrap starting.
I20260811 02:35:05.813308 10484 tablet_bootstrap.cc:654] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:05.813884 10484 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: No bootstrap required, opened a new log
I20260811 02:35:05.813936 10484 ts_tablet_manager.cc:1397] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:05.814049 10484 raft_consensus.cc:348] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.814142 10484 raft_consensus.cc:374] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:05.814193 10484 raft_consensus.cc:729] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead970dd27e84810950f05928dedb360, State: Initialized, Role: FOLLOWER
I20260811 02:35:05.814239 10484 consensus_queue.cc:260] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.814388 10484 ts_tablet_manager.cc:1428] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 02:35:05.814631 10704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.810764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:41969 (local address 127.0.0.1:37796)
0811 02:35:05.810842 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.810855 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.810898 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.811318 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.811319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.811321 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:05.811360 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.811362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.812395 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.812396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.813434 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.813435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.814403 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.814404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.814466 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.814469 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.814502 (+ 33us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.814555 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 02:35:05.815009 11158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.810984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37796 (local address 127.17.79.3:41969)
0811 02:35:05.811152 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.811157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.811168 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:35:05.811208 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.811210 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.811226 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.811314 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:05.811436 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.812293 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.813519 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.814307 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.814799 (+ 492us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.814868 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.814895 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.814932 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":111,"threads_started":1}
I20260811 02:35:05.815660 11040 tablet_service.cc:1467] Processing CreateTablet for tablet ca1e17fa8889406190242392ab0ccd7c (DEFAULT_TABLE table=test-table [id=4d700db1e25e4e82bb5aebd36182bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:05.816036 11040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1e17fa8889406190242392ab0ccd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:05.816633 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.810797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:42261 (local address 127.0.0.1:54716)
0811 02:35:05.812955 (+ 2158us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.812966 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.813028 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.813295 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.813296 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.813297 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:05.813332 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.813333 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.814586 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.814586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.815531 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.815534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.816394 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.816395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.816459 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.816463 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.816520 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.816566 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2137,"thread_start_us":87,"threads_started":1}
I20260811 02:35:05.816646 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.811040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54716 (local address 127.17.79.2:42261)
0811 02:35:05.811260 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.811264 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.813087 (+ 1823us) server_negotiation.cc:407] Connection header received
0811 02:35:05.813131 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.813134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.813150 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.813216 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:05.813396 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.814469 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.815637 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.816331 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.816393 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.816444 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.816533 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.816568 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":111,"threads_started":1}
I20260811 02:35:05.817468 10813 tablet_service.cc:1467] Processing CreateTablet for tablet ca1e17fa8889406190242392ab0ccd7c (DEFAULT_TABLE table=test-table [id=4d700db1e25e4e82bb5aebd36182bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:05.817772 10813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca1e17fa8889406190242392ab0ccd7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:05.819123 11163 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Bootstrap starting.
I20260811 02:35:05.819921 11163 tablet_bootstrap.cc:654] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:05.820492 11163 log.cc:824] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:05.821031 11171 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Bootstrap starting.
I20260811 02:35:05.821362 11163 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: No bootstrap required, opened a new log
I20260811 02:35:05.821420 11163 ts_tablet_manager.cc:1397] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:05.821656 11171 tablet_bootstrap.cc:654] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:05.822147 11171 log.cc:824] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:05.822944 11171 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: No bootstrap required, opened a new log
I20260811 02:35:05.823025 11171 ts_tablet_manager.cc:1397] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:35:05.823354 11163 raft_consensus.cc:348] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.823487 11163 raft_consensus.cc:374] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:05.823509 11163 raft_consensus.cc:729] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68f1836918b04ee0993fbc332b941f9d, State: Initialized, Role: FOLLOWER
I20260811 02:35:05.823645 11163 consensus_queue.cc:260] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.823935 11163 ts_tablet_manager.cc:1428] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 02:35:05.823971 11149 heartbeater.cc:503] Master 127.17.79.62:39339 was elected leader, sending a full tablet report...
I20260811 02:35:05.825023 11171 raft_consensus.cc:348] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.825191 11171 raft_consensus.cc:374] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:05.825227 11171 raft_consensus.cc:729] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d825f714b394c39b55eb16f95c29774, State: Initialized, Role: FOLLOWER
I20260811 02:35:05.825346 11171 consensus_queue.cc:260] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.825627 11171 ts_tablet_manager.cc:1428] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:35:05.825685 10923 heartbeater.cc:503] Master 127.17.79.62:39339 was elected leader, sending a full tablet report...
W20260811 02:35:05.907089 10924 tablet.cc:2369] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:35:05.938795 10702 raft_consensus.cc:482] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:05.938951 10702 raft_consensus.cc:504] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.939406 10702 leader_election.cc:288] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969), 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
I20260811 02:35:05.943718 11159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.939682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:37897 (local address 127.17.79.2:42261)
0811 02:35:05.939726 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.939728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.939739 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:35:05.939822 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.939823 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.939835 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.939914 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:05.940429 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.941119 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.942699 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.943294 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.943373 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.943384 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.943603 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.943649 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:35:05.943718 11158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.939707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:47095 (local address 127.17.79.3:41969)
0811 02:35:05.939758 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.939760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.939902 (+ 142us) server_negotiation.cc:407] Connection header received
0811 02:35:05.940021 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.940022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.940033 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.940103 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:05.940282 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.941070 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.942699 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.943294 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.943373 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.943383 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.943603 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.943649 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:35:05.943699 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.939608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:42261 (local address 127.17.79.1:37897)
0811 02:35:05.939666 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.939678 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.939722 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.939917 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.939918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.939920 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:05.940348 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.940349 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.941224 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.941226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.942589 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.942593 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.943401 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.943402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.943480 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.943484 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.943550 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.943595 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":85}
I20260811 02:35:05.943709 11176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.939630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:41969 (local address 127.17.79.1:47095)
0811 02:35:05.939818 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.939827 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:05.939906 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:05.940116 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:05.940117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:05.940119 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:05.940191 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.940193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.941237 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.941237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.942591 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:05.942593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.943420 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.943421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:05.943480 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.943485 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:35:05.943550 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 02:35:05.943594 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":54,"thread_start_us":112,"threads_started":1}
I20260811 02:35:05.944103 10844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1e17fa8889406190242392ab0ccd7c" candidate_uuid: "ead970dd27e84810950f05928dedb360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d825f714b394c39b55eb16f95c29774" is_pre_election: true
I20260811 02:35:05.944286 10844 raft_consensus.cc:2454] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead970dd27e84810950f05928dedb360 in term 0.
I20260811 02:35:05.944350 11076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1e17fa8889406190242392ab0ccd7c" candidate_uuid: "ead970dd27e84810950f05928dedb360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f1836918b04ee0993fbc332b941f9d" is_pre_election: true
I20260811 02:35:05.944504 11076 raft_consensus.cc:2454] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ead970dd27e84810950f05928dedb360 in term 0.
I20260811 02:35:05.944535 10475 leader_election.cc:302] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d825f714b394c39b55eb16f95c29774, ead970dd27e84810950f05928dedb360; no voters:
I20260811 02:35:05.944655 10702 raft_consensus.cc:2781] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:35:05.944731 10702 raft_consensus.cc:482] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:35:05.944773 10702 raft_consensus.cc:3037] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:05.945500 10702 raft_consensus.cc:504] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.945649 10702 leader_election.cc:288] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 1 election: Requested vote from peers 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969), 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
I20260811 02:35:05.945818 11076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1e17fa8889406190242392ab0ccd7c" candidate_uuid: "ead970dd27e84810950f05928dedb360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68f1836918b04ee0993fbc332b941f9d"
I20260811 02:35:05.945850 10844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca1e17fa8889406190242392ab0ccd7c" candidate_uuid: "ead970dd27e84810950f05928dedb360" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d825f714b394c39b55eb16f95c29774"
I20260811 02:35:05.945910 10844 raft_consensus.cc:3037] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:05.945915 11076 raft_consensus.cc:3037] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:05.946748 11076 raft_consensus.cc:2454] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead970dd27e84810950f05928dedb360 in term 1.
I20260811 02:35:05.946820 10844 raft_consensus.cc:2454] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ead970dd27e84810950f05928dedb360 in term 1.
I20260811 02:35:05.947048 10475 leader_election.cc:302] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d825f714b394c39b55eb16f95c29774, ead970dd27e84810950f05928dedb360; no voters:
I20260811 02:35:05.947232 10702 raft_consensus.cc:2781] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:35:05.947431 10702 raft_consensus.cc:686] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 LEADER]: Becoming Leader. State: Replica: ead970dd27e84810950f05928dedb360, State: Running, Role: LEADER
I20260811 02:35:05.947521 10702 consensus_queue.cc:237] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:05.948340 10347 catalog_manager.cc:5495] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 reported cstate change: term changed from 0 to 1, leader changed from <none> to ead970dd27e84810950f05928dedb360 (127.17.79.1). New cstate: current_term: 1 leader_uuid: "ead970dd27e84810950f05928dedb360" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } health_report { overall_health: HEALTHY } } }
I20260811 02:35:05.959621 10705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.957410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42210 (local address 127.17.79.1:33571)
0811 02:35:05.957468 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:05.957470 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:05.957478 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:35:05.957537 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:05.957537 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:05.957555 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:05.957620 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:35:05.957721 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.958192 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.958955 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:05.959140 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:05.959189 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:05.959314 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:35:05.959405 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:35:05.959457 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:05.959497 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 02:35:05.959515 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 02:35:05.961179 11076 raft_consensus.cc:1261] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Refusing update from remote peer ead970dd27e84810950f05928dedb360: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:05.961184 10844 raft_consensus.cc:1261] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 1 FOLLOWER]: Refusing update from remote peer ead970dd27e84810950f05928dedb360: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:05.961524 10702 consensus_queue.cc:1035] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:05.961673 11177 consensus_queue.cc:1035] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:05.964027 11182 mvcc.cc:205] Tried to move back new op lower bound from 7317158731614527488 to 7317158731561709568. Current Snapshot: MvccSnapshot[applied={T|T < 7317158731614527488}]
I20260811 02:35:05.965402 11185 mvcc.cc:205] Tried to move back new op lower bound from 7317158731614527488 to 7317158731561709568. Current Snapshot: MvccSnapshot[applied={T|T < 7317158731614527488 or (T in {7317158731614527488})}]
I20260811 02:35:05.966364 10347 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:05.966460 10347 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:05.967216 10347 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Sending DeleteTablet for 3 replicas of tablet ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:05.967617 10552 tablet_service.cc:1514] Processing DeleteTablet for tablet ca1e17fa8889406190242392ab0ccd7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:05 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:42202
I20260811 02:35:05.967650 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 10421
I20260811 02:35:05.967634 10813 tablet_service.cc:1514] Processing DeleteTablet for tablet ca1e17fa8889406190242392ab0ccd7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:05 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:54716
I20260811 02:35:05.967767 11040 tablet_service.cc:1514] Processing DeleteTablet for tablet ca1e17fa8889406190242392ab0ccd7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:05 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:37796
I20260811 02:35:05.967944 10706 tablet_replica.cc:330] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: stopping tablet replica
I20260811 02:35:05.967998 10706 raft_consensus.cc:2229] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:35:05.968076 10706 raft_consensus.cc:2258] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:05.977141 11196 tablet_replica.cc:330] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: stopping tablet replica
I20260811 02:35:05.977172 11197 tablet_replica.cc:330] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: stopping tablet replica
I20260811 02:35:05.977298 11196 raft_consensus.cc:2229] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:05.977316 11197 raft_consensus.cc:2229] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:05.977427 11196 raft_consensus.cc:2258] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:05.977425 11197 raft_consensus.cc:2258] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:05.977874 11196 ts_tablet_manager.cc:1905] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:05.978012 11197 ts_tablet_manager.cc:1905] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:05.979849 11196 ts_tablet_manager.cc:1918] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:05.979928 11196 log.cc:1196] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:05.980199 11196 ts_tablet_manager.cc:1939] T ca1e17fa8889406190242392ab0ccd7c P 5d825f714b394c39b55eb16f95c29774: Deleting consensus metadata
I20260811 02:35:05.980289 11197 ts_tablet_manager.cc:1918] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:05.980377 11197 log.cc:1196] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:05.980659 10325 catalog_manager.cc:4841] TS 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261): tablet ca1e17fa8889406190242392ab0ccd7c (table test-table [id=4d700db1e25e4e82bb5aebd36182bac2]) successfully deleted
I20260811 02:35:05.981047 11197 ts_tablet_manager.cc:1939] T ca1e17fa8889406190242392ab0ccd7c P 68f1836918b04ee0993fbc332b941f9d: Deleting consensus metadata
I20260811 02:35:05.981508 10326 catalog_manager.cc:4841] TS 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969): tablet ca1e17fa8889406190242392ab0ccd7c (table test-table [id=4d700db1e25e4e82bb5aebd36182bac2]) successfully deleted
W20260811 02:35:05.987272 10324 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:33571 (error 108)
I20260811 02:35:05.987488 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 10701
I20260811 02:35:05.997658 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:05.994704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:33571 (local address 127.0.0.1:42216)
0811 02:35:05.997567 (+ 2863us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:05.997621 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2838}
W20260811 02:35:05.997857 10324 catalog_manager.cc:4584] TS ead970dd27e84810950f05928dedb360 (127.17.79.1:33571): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca1e17fa8889406190242392ab0ccd7c: Network error: Client connection negotiation failed: client connection to 127.17.79.1:33571: connect: Connection refused (error 111)
I20260811 02:35:06.011476 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 10926
I20260811 02:35:06.023741 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 10297
I20260811 02:35:06.035743 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39339
--webserver_interface=127.17.79.62
--webserver_port=44241
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:39339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:06.122581 11199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:06.122808 11199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:06.122846 11199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:06.123976 11199 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:35:06.124043 11199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:06.124070 11199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:06.124102 11199 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:35:06.124126 11199 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:35:06.125813 11199 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:39339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=44241
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:06.126087 11199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:06.126345 11199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:06.131186 11205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:06.131314 11199 server_base.cc:1034] running on GCE node
W20260811 02:35:06.131220 11206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:06.131433 11210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:06.131677 11199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:06.131911 11199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:06.133095 11199 hybrid_clock.cc:648] HybridClock initialized: now 1786415706133076 us; error 37 us; skew 500 ppm
Aug 11 02:35:06 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:06.135648 11199 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:35:06.136125 11199 webserver.cc:460] Webserver started at http://127.17.79.62:44241/ using document root <none> and password file <none>
I20260811 02:35:06.136430 11199 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:06.136479 11199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:06.137758 11199 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:35:06.138489 11217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.138702 11199 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:35:06.138767 11199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "e7b04dd901c61b963bbc345045b74ca1"
server_key_iv: "55796e4aa1881e960fc17e2cb6a942e3"
server_key_version: "encryptionkey@0"
I20260811 02:35:06.139065 11199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:06.151008 11199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:06.152911 11199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:06.153023 11199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:06.157435 11199 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:39339
I20260811 02:35:06.157490 11315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:39339 every 8 connection(s)
I20260811 02:35:06.157867 11199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:35:06.159700 11317 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:35:06.160305 11317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Bootstrap starting.
I20260811 02:35:06.161867 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 11199
I20260811 02:35:06.162364 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:33571
--local_ip_for_outbound_sockets=127.17.79.1
--tserver_master_addrs=127.17.79.62:39339
--webserver_port=38229
--webserver_interface=127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:35:06.169245 11317 log.cc:824] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:06.171981 11317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:35:06.172292 11317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b: Bootstrap complete.
I20260811 02:35:06.174669 11317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:06.174921 11317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee15af0bffa4941b1e9b39bddbe2f6b, State: Initialized, Role: FOLLOWER
I20260811 02:35:06.175107 11317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:06.175184 11317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:35:06.175237 11317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:35:06.175287 11317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 2 FOLLOWER]: Advancing to term 3
I20260811 02:35:06.176288 11317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:06.176411 11317 leader_election.cc:302] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ee15af0bffa4941b1e9b39bddbe2f6b; no voters:
I20260811 02:35:06.176635 11317 leader_election.cc:288] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 02:35:06.176671 11321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 3 FOLLOWER]: Leader election won for term 3
I20260811 02:35:06.176788 11321 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [term 3 LEADER]: Becoming Leader. State: Replica: 0ee15af0bffa4941b1e9b39bddbe2f6b, State: Running, Role: LEADER
I20260811 02:35:06.176923 11317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:35:06.176893 11321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } }
I20260811 02:35:06.177198 11324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ee15af0bffa4941b1e9b39bddbe2f6b. Latest consensus state: current_term: 3 leader_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } } }
I20260811 02:35:06.177400 11324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:06.177343 11323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee15af0bffa4941b1e9b39bddbe2f6b" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39339 } } }
I20260811 02:35:06.177644 11323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee15af0bffa4941b1e9b39bddbe2f6b [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:06.177778 11337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:35:06.178690 11337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:35:06.178819 11337 catalog_manager.cc:1259] Loaded cluster ID: 4b820af7aa73476db61b77f3b5e6974a
I20260811 02:35:06.178876 11337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 02:35:06.179302 11337 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5dc12339ad google::LogMessage::Fail() at ??:0
@ 0x7f5dc123688a google::LogMessage::SendToLog() at ??:0
@ 0x7f5dc12334de google::LogMessage::Flush() at ??:0
@ 0x7f5dc1234a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5dc91540f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f5dc915d8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5dc31010d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5dc30f6954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5dc3f5a6db start_thread at ??:0
@ 0x7f5dbfd3161f clone at ??:0
W20260811 02:35:06.264215 11319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:06.264425 11319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:06.264451 11319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:06.265635 11319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:06.265681 11319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:06.265709 11319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:35:06.267581 11319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:33571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=38229
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:06.267867 11319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:06.268158 11319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:06.273419 11399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:06.273617 11319 server_base.cc:1034] running on GCE node
W20260811 02:35:06.273429 11404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:06.273548 11400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:06.273890 11319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:06.274187 11319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:06.275411 11319 hybrid_clock.cc:648] HybridClock initialized: now 1786415706275399 us; error 28 us; skew 500 ppm
Aug 11 02:35:06 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:06.278412 11319 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:35:06.278945 11319 webserver.cc:460] Webserver started at http://127.17.79.1:38229/ using document root <none> and password file <none>
I20260811 02:35:06.279227 11319 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:06.279294 11319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:06.281107 11319 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 02:35:06.281953 11414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.282366 11319 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:06.282481 11319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "ead970dd27e84810950f05928dedb360"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "6a6fb84817c9e4f494710dd6196458f8"
server_key_iv: "0ba5e9cb65099da198b0bba2c51cd64b"
server_key_version: "encryptionkey@0"
I20260811 02:35:06.282960 11319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:06.319562 11319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:06.322156 11319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:06.322469 11319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:06.322798 11319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:06.323302 11435 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 02:35:06.324800 11319 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 02:35:06.324862 11319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 02:35:06.324898 11319 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 02:35:06.325898 11319 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 02:35:06.325948 11319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:06.326040 11435 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Bootstrap starting.
I20260811 02:35:06.333313 11319 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:33571
I20260811 02:35:06.333515 11647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:33571 every 8 connection(s)
I20260811 02:35:06.333819 11319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:35:06.336705 11435 log.cc:824] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:06.338948 11435 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:35:06.339242 11435 tablet_bootstrap.cc:492] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Bootstrap complete.
I20260811 02:35:06.340217 11435 ts_tablet_manager.cc:1397] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260811 02:35:06.341221 11435 raft_consensus.cc:348] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:06.341467 11435 raft_consensus.cc:729] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead970dd27e84810950f05928dedb360, State: Initialized, Role: FOLLOWER
I20260811 02:35:06.341650 11435 consensus_queue.cc:260] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:06.341970 11435 ts_tablet_manager.cc:1428] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 02:35:06.342941 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 11319
I20260811 02:35:06.343209 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:42261
--local_ip_for_outbound_sockets=127.17.79.2
--tserver_master_addrs=127.17.79.62:39339
--webserver_port=38503
--webserver_interface=127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:06.383249 11650 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:35:06.334595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:39167)
0811 02:35:06.334820 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.334871 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:06.335480 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:06.383047 (+ 47567us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":110,"threads_started":1}
W20260811 02:35:06.383496 11648 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:39339 (0 consecutive failures): Network error: Failed to ping master at 127.17.79.62:39339: Client connection negotiation failed: client connection to 127.17.79.62:39339: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 02:35:06.383838 11650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.383715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:56939)
0811 02:35:06.383771 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.383819 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 02:35:06.384245 11650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.384157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:36025)
0811 02:35:06.384205 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.384229 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 02:35:06.384382 11648 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 02:35:06.436137 11657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:06.436331 11657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:06.436357 11657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:06.437493 11657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:06.437536 11657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:06.437563 11657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:35:06.439703 11657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:42261
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=38503
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:06.439956 11657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:06.440222 11657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:06.446553 11672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:06.446626 11675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:06.446717 11657 server_base.cc:1034] running on GCE node
W20260811 02:35:06.447852 11667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:06.448956 11657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:06.449249 11657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:06.450412 11657 hybrid_clock.cc:648] HybridClock initialized: now 1786415706450401 us; error 50 us; skew 500 ppm
Aug 11 02:35:06 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:06.452894 11657 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:35:06.453379 11657 webserver.cc:460] Webserver started at http://127.17.79.2:38503/ using document root <none> and password file <none>
I20260811 02:35:06.453629 11657 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:06.453703 11657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:06.455083 11657 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:35:06.455703 11692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.455878 11657 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:35:06.455968 11657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "5d825f714b394c39b55eb16f95c29774"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "f9ba8d23046e828998e07eaf04f8469c"
server_key_iv: "770651e9b981825b394f02d3ff3e9225"
server_key_version: "encryptionkey@0"
I20260811 02:35:06.456313 11657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:06.480445 11657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:06.482414 11657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:06.482580 11657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:06.482872 11657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:06.483193 11657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:06.483247 11657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.483284 11657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:06.483331 11657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.489671 11657 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:42261
I20260811 02:35:06.489709 11891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:42261 every 8 connection(s)
I20260811 02:35:06.490083 11657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:35:06.491243 11896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.490812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:51365)
0811 02:35:06.491007 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.491099 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
W20260811 02:35:06.491648 11894 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:39339 (0 consecutive failures): Network error: Failed to ping master at 127.17.79.62:39339: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
I20260811 02:35:06.491923 11896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.491837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:48365)
0811 02:35:06.491880 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.491907 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 02:35:06.492213 11896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.492130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:52615)
0811 02:35:06.492177 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.492198 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 02:35:06.492333 11894 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 02:35:06.500046 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 11657
I20260811 02:35:06.500344 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:41969
--local_ip_for_outbound_sockets=127.17.79.3
--tserver_master_addrs=127.17.79.62:39339
--webserver_port=45597
--webserver_interface=127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:06.581775 11898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:06.581965 11898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:06.581988 11898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:06.583122 11898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:06.583163 11898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:06.583189 11898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:35:06.584627 11898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:41969
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=45597
--tserver_master_addrs=127.17.79.62:39339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:06.584878 11898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:06.585114 11898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:06.590116 11911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:06.590219 11907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:06.590176 11906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:06.590327 11898 server_base.cc:1034] running on GCE node
I20260811 02:35:06.590518 11898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:06.590782 11898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:06.591944 11898 hybrid_clock.cc:648] HybridClock initialized: now 1786415706591939 us; error 36 us; skew 500 ppm
Aug 11 02:35:06 dist-test-slave-7nm7 krb5kdc[9299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:06.594311 11898 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:35:06.594780 11898 webserver.cc:460] Webserver started at http://127.17.79.3:45597/ using document root <none> and password file <none>
I20260811 02:35:06.594998 11898 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:06.595067 11898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:06.596387 11898 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:06.597038 11928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.597266 11898 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:06.597380 11898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "68f1836918b04ee0993fbc332b941f9d"
format_stamp: "Formatted at 2026-08-11 02:35:04 on dist-test-slave-7nm7"
server_key: "8e958d521dc34144ef2545cf30afee54"
server_key_iv: "d88d623b6c574d68f2f8dea13e6bfbd2"
server_key_version: "encryptionkey@0"
I20260811 02:35:06.597736 11898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:06.617560 11898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:06.619587 11898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:06.619766 11898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:06.620004 11898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:06.620326 11898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:06.620385 11898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.620420 11898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:06.620446 11898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:06.626425 11898 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:41969
I20260811 02:35:06.626482 12129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:41969 every 8 connection(s)
I20260811 02:35:06.626816 11898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:35:06.627794 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.627429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:54513)
0811 02:35:06.627579 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.627654 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
W20260811 02:35:06.628206 12133 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:39339 (0 consecutive failures): Network error: Failed to ping master at 127.17.79.62:39339: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
I20260811 02:35:06.628541 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.628452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:45859)
0811 02:35:06.628497 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.628524 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 02:35:06.628851 12135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:06.628780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:39807)
0811 02:35:06.628816 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:06.628837 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 02:35:06.628983 12133 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 02:35:06.636200 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 11898
I20260811 02:35:07.385119 12139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:07.384829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:40261)
0811 02:35:07.384984 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:07.385030 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260811 02:35:07.493104 12145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:07.492862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:38761)
0811 02:35:07.493007 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:07.493047 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":73,"threads_started":1}
I20260811 02:35:07.629443 12146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:07.629262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:49891)
0811 02:35:07.629371 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:07.629402 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260811 02:35:07.933427 12150 raft_consensus.cc:482] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:07.933569 12150 raft_consensus.cc:504] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:07.933893 12150 leader_election.cc:288] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969), 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
Aug 11 02:35:07 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.3@KRBTEST.COM
Aug 11 02:35:07 dist-test-slave-7nm7 krb5kdc[9299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.2@KRBTEST.COM
I20260811 02:35:07.950644 12153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:07.934170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:49329 (local address 127.17.79.3:41969)
0811 02:35:07.934360 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:07.934372 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:07.934415 (+ 43us) server_negotiation.cc:407] Connection header received
0811 02:35:07.934994 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:07.934998 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:07.935055 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:07.935215 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:07.936321 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.937720 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.939557 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.940211 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.940326 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:07.946657 (+ 6331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:07.946662 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:07.946663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:07.946676 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:07.948583 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:07.949133 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:07.949137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:07.949138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:07.949275 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:07.949653 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:07.949654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:07.949654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:07.949933 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:07.949997 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:07.950389 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 02:35:07.950520 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":74,"threads_started":1}
I20260811 02:35:07.950639 12151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:07.934093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:42261 (local address 127.17.79.1:37711)
0811 02:35:07.934253 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:07.934263 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:07.934329 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:07.935297 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:07.935301 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:07.935868 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:07.936161 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:07.936168 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.937877 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.937878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:07.939445 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:07.939449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.940310 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.940311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:07.940462 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:07.944480 (+ 4018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:07.944491 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:07.946955 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:07.948902 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:07.948903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:07.948903 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:07.949176 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:07.949640 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:07.949641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:07.949641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:07.949712 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:07.950221 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:07.950221 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:07.950309 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 02:35:07.950376 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 02:35:07.950533 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":91,"thread_start_us":73,"threads_started":1}
I20260811 02:35:07.950960 12155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:07.934261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:37711 (local address 127.17.79.2:42261)
0811 02:35:07.934407 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:07.934414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:07.934442 (+ 28us) server_negotiation.cc:407] Connection header received
0811 02:35:07.934995 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:07.934998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:07.935056 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:07.935215 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:07.936322 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.937748 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.939559 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.940198 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.940326 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:07.947072 (+ 6746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:07.947075 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:07.947076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:07.947088 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:07.948814 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:07.949343 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:07.949347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:07.949347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:07.949513 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:07.949817 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:07.949818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:07.949819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:07.950128 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:07.950250 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:07.950479 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 02:35:07.950618 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":56,"threads_started":1}
I20260811 02:35:07.951326 12152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:07.934043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:41969 (local address 127.17.79.1:49329)
0811 02:35:07.934247 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:07.934259 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:07.934329 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:07.935297 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:07.935301 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:07.935862 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:07.936161 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:07.936169 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.937891 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.937892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:07.939445 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:07.939449 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:07.940311 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:07.940312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:07.940462 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:07.944480 (+ 4018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:07.944491 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:07.946530 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:07.948686 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:07.948694 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:07.948696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:07.949034 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:07.949364 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:07.949365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:07.949365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:07.949552 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:07.950017 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:07.950024 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:07.950181 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 02:35:07.950304 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 02:35:07.950619 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":395,"thread_start_us":59,"threads_started":1}
W20260811 02:35:07.951771 11424 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
W20260811 02:35:07.952092 11427 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:07.952142 11427 leader_election.cc:302] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ead970dd27e84810950f05928dedb360; no voters: 5d825f714b394c39b55eb16f95c29774, 68f1836918b04ee0993fbc332b941f9d
I20260811 02:35:07.952250 12150 raft_consensus.cc:2726] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:35:08.385838 12152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:08.385683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:53919)
0811 02:35:08.385755 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:08.385796 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 02:35:08.493770 12159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:08.493577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:54231)
0811 02:35:08.493701 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:08.493734 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":57,"threads_started":1}
I20260811 02:35:08.630180 12160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:08.629895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:43673)
0811 02:35:08.630082 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:08.630123 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":119,"threads_started":1}
I20260811 02:35:09.386718 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:09.386457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:56655)
0811 02:35:09.386611 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:09.386666 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
I20260811 02:35:09.494519 12163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:09.494321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:33493)
0811 02:35:09.494440 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:09.494478 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260811 02:35:09.630882 12164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:09.630657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:46265)
0811 02:35:09.630802 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:09.630840 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":63,"threads_started":1}
I20260811 02:35:09.814486 12165 raft_consensus.cc:482] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:09.814621 12165 raft_consensus.cc:504] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:09.814837 12165 leader_election.cc:288] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969), 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
W20260811 02:35:09.815372 11424 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
W20260811 02:35:09.815469 11427 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:09.815569 11427 leader_election.cc:302] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ead970dd27e84810950f05928dedb360; no voters: 5d825f714b394c39b55eb16f95c29774, 68f1836918b04ee0993fbc332b941f9d
I20260811 02:35:09.815692 12165 raft_consensus.cc:2726] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:35:10.387527 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:10.387279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:33333)
0811 02:35:10.387440 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:10.387479 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
I20260811 02:35:10.495237 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:10.495011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:58093)
0811 02:35:10.495155 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:10.495194 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260811 02:35:10.631716 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:10.631476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:53447)
0811 02:35:10.631619 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:10.631661 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":63,"threads_started":1}
I20260811 02:35:11.388377 12171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:11.388163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:43857)
0811 02:35:11.388298 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:11.388330 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260811 02:35:11.496024 12172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:11.495762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:60887)
0811 02:35:11.495939 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:11.495978 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":88,"threads_started":1}
I20260811 02:35:11.559336 12174 raft_consensus.cc:482] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:11.559451 12174 raft_consensus.cc:504] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:11.559669 12174 leader_election.cc:288] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969), 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
W20260811 02:35:11.560031 11424 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
W20260811 02:35:11.560119 11427 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:11.560184 11427 leader_election.cc:302] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ead970dd27e84810950f05928dedb360; no voters: 5d825f714b394c39b55eb16f95c29774, 68f1836918b04ee0993fbc332b941f9d
I20260811 02:35:11.560278 12174 raft_consensus.cc:2726] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:35:11.632452 12175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:11.632212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:39461)
0811 02:35:11.632376 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:11.632412 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260811 02:35:12.389222 12176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:12.388983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:60397)
0811 02:35:12.389131 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:12.389172 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260811 02:35:12.496776 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:12.496559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:34201)
0811 02:35:12.496689 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:12.496731 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260811 02:35:12.633203 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:12.632967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:43663)
0811 02:35:12.633109 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:12.633159 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260811 02:35:13.389995 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:13.389735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:44353)
0811 02:35:13.389909 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:13.389947 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":67,"threads_started":1}
I20260811 02:35:13.497483 12187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:13.497258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:42651)
0811 02:35:13.497396 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:13.497436 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260811 02:35:13.633922 12191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:13.633712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:43285)
0811 02:35:13.633838 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:13.633877 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260811 02:35:14.390789 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:14.390548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:47037)
0811 02:35:14.390696 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:14.390732 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":68,"threads_started":1}
I20260811 02:35:14.451443 12197 raft_consensus.cc:482] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:14.451561 12197 raft_consensus.cc:504] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:14.451792 12197 leader_election.cc:288] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969), 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
W20260811 02:35:14.452178 11424 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
W20260811 02:35:14.452309 11427 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:14.452368 11427 leader_election.cc:302] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ead970dd27e84810950f05928dedb360; no voters: 5d825f714b394c39b55eb16f95c29774, 68f1836918b04ee0993fbc332b941f9d
I20260811 02:35:14.452437 12197 raft_consensus.cc:2726] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:35:14.498345 12198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:14.498022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:49871)
0811 02:35:14.498192 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:14.498294 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260811 02:35:14.634696 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:14.634482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:54117)
0811 02:35:14.634620 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:14.634655 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260811 02:35:15.391613 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:15.391352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:42211)
0811 02:35:15.391508 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:15.391564 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260811 02:35:15.499085 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:15.498839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:36275)
0811 02:35:15.498988 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:15.499036 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260811 02:35:15.635461 12205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:15.635184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:45267)
0811 02:35:15.635376 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:15.635415 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":80,"threads_started":1}
I20260811 02:35:16.392408 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:16.392168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:52253)
0811 02:35:16.392322 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:16.392360 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":73,"threads_started":1}
I20260811 02:35:16.499922 12207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:16.499720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:39081)
0811 02:35:16.499843 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:16.499879 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
I20260811 02:35:16.636345 12208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:16.636067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:37979)
0811 02:35:16.636242 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:16.636297 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
I20260811 02:35:17.393100 12210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:17.392874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:38123)
0811 02:35:17.393001 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:17.393040 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260811 02:35:17.500710 12213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:17.500416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:54913)
0811 02:35:17.500627 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:17.500663 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":101,"threads_started":1}
I20260811 02:35:17.637140 12214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:17.636872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:56965)
0811 02:35:17.637026 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:17.637075 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
I20260811 02:35:18.393867 12215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:18.393623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:33781)
0811 02:35:18.393775 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:18.393818 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260811 02:35:18.501482 12219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:18.501212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:56433)
0811 02:35:18.501399 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:18.501439 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":135,"threads_started":1}
I20260811 02:35:18.637892 12220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:18.637669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:35061)
0811 02:35:18.637810 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:18.637848 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260811 02:35:19.394676 12222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:19.394433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:33373)
0811 02:35:19.394574 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:19.394617 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260811 02:35:19.493598 12223 raft_consensus.cc:482] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:19.493698 12223 raft_consensus.cc:504] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68f1836918b04ee0993fbc332b941f9d" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 41969 } } peers { permanent_uuid: "5d825f714b394c39b55eb16f95c29774" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 42261 } } peers { permanent_uuid: "ead970dd27e84810950f05928dedb360" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 33571 } }
I20260811 02:35:19.493880 12223 leader_election.cc:288] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969), 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261)
W20260811 02:35:19.494335 11427 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 68f1836918b04ee0993fbc332b941f9d (127.17.79.3:41969): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
W20260811 02:35:19.494444 11424 leader_election.cc:341] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5d825f714b394c39b55eb16f95c29774 (127.17.79.2:42261): Not found: Tablet not found: ca1e17fa8889406190242392ab0ccd7c
I20260811 02:35:19.494481 11424 leader_election.cc:302] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ead970dd27e84810950f05928dedb360; no voters: 5d825f714b394c39b55eb16f95c29774, 68f1836918b04ee0993fbc332b941f9d
I20260811 02:35:19.494581 12223 raft_consensus.cc:2726] T ca1e17fa8889406190242392ab0ccd7c P ead970dd27e84810950f05928dedb360 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:35:19.502413 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:19.502121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:55063)
0811 02:35:19.502331 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:19.502368 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":70,"threads_started":1}
I20260811 02:35:19.638796 12230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:19.638545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:59517)
0811 02:35:19.638685 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:19.638732 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260811 02:35:20.395488 12232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:20.395224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:52205)
0811 02:35:20.395391 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:20.395431 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
I20260811 02:35:20.503157 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:20.502924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:45043)
0811 02:35:20.503070 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:20.503109 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":71,"threads_started":1}
I20260811 02:35:20.639513 12234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:20.639290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:44771)
0811 02:35:20.639433 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:20.639470 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
I20260811 02:35:21.396407 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:21.396159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.1:36943)
0811 02:35:21.396318 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:21.396356 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260811 02:35:21.504006 12239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:21.503723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.2:58761)
0811 02:35:21.503910 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:21.503951 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":111,"threads_started":1}
I20260811 02:35:21.640367 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:21.640155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:39339 (local address 127.17.79.3:38903)
0811 02:35:21.640281 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:21.640323 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:39339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260811 02:35:21.641183 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 11319
I20260811 02:35:21.656988 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 11657
I20260811 02:35:21.671175 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 11898
2026-08-11T02:35:21Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19024 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:35:21 dist-test-slave-7nm7 krb5kdc[12246](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:35:21 dist-test-slave-7nm7 krb5kdc[12246](info): set up 2 sockets
Aug 11 02:35:21 dist-test-slave-7nm7 krb5kdc[12246](info): commencing operation
krb5kdc: starting...
W20260811 02:35:22.987706 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:35:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:35:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:35:23.117537 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45767
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:23.200650 12268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:23.200886 12268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:23.200920 12268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:23.202044 12268 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 02:35:23.202109 12268 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 02:35:23.202131 12268 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 02:35:23.202148 12268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:35:23.202186 12268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:23.202211 12268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:23.202282 12268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:35:23.202310 12268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:35:23.203804 12268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:23.204087 12268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:23.204331 12268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:23.209282 12275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:23.209331 12277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:23.209453 12268 server_base.cc:1034] running on GCE node
W20260811 02:35:23.209331 12279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:23.209738 12268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:23.210055 12268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:23.211223 12268 hybrid_clock.cc:648] HybridClock initialized: now 1786415723211195 us; error 41 us; skew 500 ppm
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:23.213737 12268 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:35:23.214208 12268 webserver.cc:460] Webserver started at http://127.17.79.62:38009/ using document root <none> and password file <none>
I20260811 02:35:23.214514 12268 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:23.214587 12268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:23.214744 12268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:23.215785 12268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "7c3e9292caeb4b5fbe41ddda40f53150"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "49491072a4b5d0c4c280e80c8bd9c5c5"
server_key_iv: "35bf6a8fea24c65f3e935e1814eb06a3"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.216136 12268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "7c3e9292caeb4b5fbe41ddda40f53150"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "49491072a4b5d0c4c280e80c8bd9c5c5"
server_key_iv: "35bf6a8fea24c65f3e935e1814eb06a3"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.217483 12268 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:35:23.218297 12293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.218499 12268 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:23.218603 12268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "7c3e9292caeb4b5fbe41ddda40f53150"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "49491072a4b5d0c4c280e80c8bd9c5c5"
server_key_iv: "35bf6a8fea24c65f3e935e1814eb06a3"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.218690 12268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:23.228844 12268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:23.231252 12268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:23.231426 12268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:23.235874 12268 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:45767
I20260811 02:35:23.235906 12381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:45767 every 8 connection(s)
I20260811 02:35:23.236269 12268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:35:23.237145 12382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:23.239492 12382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Bootstrap starting.
I20260811 02:35:23.240046 12382 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:23.240440 12382 log.cc:824] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:23.241139 12382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: No bootstrap required, opened a new log
I20260811 02:35:23.243065 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 12268
I20260811 02:35:23.243172 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:35:23.243351 17724 external_mini_cluster.cc:1428] Setting key 63633a588e9ffaeee8aac226a1f3efef
I20260811 02:35:23.243229 12382 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:23.243397 12382 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:23.243434 12382 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c3e9292caeb4b5fbe41ddda40f53150, State: Initialized, Role: FOLLOWER
I20260811 02:35:23.243589 12382 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:23.243685 12382 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:35:23.243710 12382 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:35:23.243782 12382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:23.244858 12382 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:23.244984 12382 leader_election.cc:302] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c3e9292caeb4b5fbe41ddda40f53150; no voters:
I20260811 02:35:23.245165 12382 leader_election.cc:288] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:35:23.245220 12390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:35:23.245371 12390 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 LEADER]: Becoming Leader. State: Replica: 7c3e9292caeb4b5fbe41ddda40f53150, State: Running, Role: LEADER
I20260811 02:35:23.245553 12390 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:23.245437 12382 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:35:23.246740 12391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c3e9292caeb4b5fbe41ddda40f53150. Latest consensus state: current_term: 1 leader_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } } }
I20260811 02:35:23.246876 12391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:23.247148 12414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:35:23.247337 12394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } } }
I20260811 02:35:23.247552 12394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:23.247977 12414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:35:23.249472 12414 catalog_manager.cc:1347] Generated new cluster ID: 5f0187c2875a4568b3f86db92a07cffd
I20260811 02:35:23.249528 12414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:23.255663 12387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.244135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57122 (local address 127.17.79.62:45767)
0811 02:35:23.244336 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.244344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.244368 (+ 24us) server_negotiation.cc:407] Connection header received
0811 02:35:23.244486 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.244492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.244564 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.244722 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:23.245602 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.247232 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.248284 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.248912 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.249028 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.252013 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:23.252016 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:23.252017 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:23.252028 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:23.253918 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.254351 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.254354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.254354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.254476 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.254705 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.254706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.254706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.254985 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:23.255115 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.255248 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.255375 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":97,"threads_started":1}
I20260811 02:35:23.262362 12414 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:35:23.262882 12414 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:35:23.274863 12414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Generated new TSK 0
I20260811 02:35:23.275079 12414 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:35:23.305130 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45767
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:23.388845 12422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:23.389042 12422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:23.389065 12422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:23.390224 12422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:23.390311 12422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:23.390372 12422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:35:23.391811 12422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:23.391995 12422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:23.392158 12422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:23.397151 12436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:23.397182 12433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:23.397266 12422 server_base.cc:1034] running on GCE node
W20260811 02:35:23.397413 12431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:23.397647 12422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:23.397902 12422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:23.399060 12422 hybrid_clock.cc:648] HybridClock initialized: now 1786415723399014 us; error 67 us; skew 500 ppm
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:23.401672 12422 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:35:23.402100 12422 webserver.cc:460] Webserver started at http://127.17.79.1:40515/ using document root <none> and password file <none>
I20260811 02:35:23.402385 12422 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:23.402458 12422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:23.402617 12422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:23.403645 12422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "6538f72204e24c899521addd6b469b2b"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "fb65b0305bc482b43cd71c1201ba6d35"
server_key_iv: "46de74cc69799344fa2eaa2c8e097809"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.404011 12422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "6538f72204e24c899521addd6b469b2b"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "fb65b0305bc482b43cd71c1201ba6d35"
server_key_iv: "46de74cc69799344fa2eaa2c8e097809"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.405413 12422 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:35:23.406217 12446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.406484 12422 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:23.406590 12422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "6538f72204e24c899521addd6b469b2b"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "fb65b0305bc482b43cd71c1201ba6d35"
server_key_iv: "46de74cc69799344fa2eaa2c8e097809"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.406687 12422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:23.415647 12422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:23.417629 12422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:23.417829 12422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:23.418107 12422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:23.418551 12422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:23.418627 12422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.418672 12422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:23.418721 12422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.425348 12422 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:37397
I20260811 02:35:23.425423 12653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:37397 every 8 connection(s)
I20260811 02:35:23.425782 12422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:35:23.431118 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 12422
I20260811 02:35:23.431231 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:35:23.431429 17724 external_mini_cluster.cc:1428] Setting key d14f9a1a71eea89e16fd36382b90471f
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:23.436031 12657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.426580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:51295)
0811 02:35:23.426766 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:23.426810 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:23.427303 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:23.427517 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:23.427520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:23.428109 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:23.428303 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.428307 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.429032 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.429033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.429820 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.429821 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.430202 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.430203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.430342 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.430822 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:23.430831 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:23.432696 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:23.434658 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:23.434666 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:23.434668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:23.434891 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:23.435127 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:23.435127 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:23.435128 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:23.435246 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:23.435544 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:23.435548 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:23.435664 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 02:35:23.435748 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 02:35:23.435871 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
I20260811 02:35:23.436029 12387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.426631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:51295 (local address 127.17.79.62:45767)
0811 02:35:23.426693 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.426696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.426907 (+ 211us) server_negotiation.cc:407] Connection header received
0811 02:35:23.427390 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.427391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.427401 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.427461 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:23.428415 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.428938 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.429907 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.430113 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.430173 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.432799 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:23.432801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:23.432801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:23.432814 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:23.434556 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.434968 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.434970 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.434970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.435042 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.435316 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.435317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.435317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.435475 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:23.435550 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.435795 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.435894 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 02:35:23.436666 12654 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45767
I20260811 02:35:23.436764 12654 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:23.436964 12654 heartbeater.cc:511] Master 127.17.79.62:45767 requested a full tablet report, sending...
I20260811 02:35:23.437520 12319 ts_manager.cc:194] Registered new tserver with Master: 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397)
I20260811 02:35:23.438161 12319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:51295
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:35:23.459506 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45767
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:23.545841 12662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:23.546061 12662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:23.546087 12662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:23.547303 12662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:23.547346 12662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:23.547374 12662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:35:23.548818 12662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:23.549000 12662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:23.549182 12662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:23.554026 12670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:23.554036 12673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:23.554036 12671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:23.554340 12662 server_base.cc:1034] running on GCE node
I20260811 02:35:23.554574 12662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:23.554807 12662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:23.555982 12662 hybrid_clock.cc:648] HybridClock initialized: now 1786415723555966 us; error 29 us; skew 500 ppm
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:23.558511 12662 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:35:23.558966 12662 webserver.cc:460] Webserver started at http://127.17.79.2:46289/ using document root <none> and password file <none>
I20260811 02:35:23.559173 12662 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:23.559216 12662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:23.559304 12662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:23.560292 12662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "83f7a6fcb1ba4cde88ec47722d5c1370"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "0357d4ee474ae955397f08ffe7f323c6"
server_key_iv: "edcca7f6b49f28f8df8299b92a9253c8"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.560616 12662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "83f7a6fcb1ba4cde88ec47722d5c1370"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "0357d4ee474ae955397f08ffe7f323c6"
server_key_iv: "edcca7f6b49f28f8df8299b92a9253c8"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.561920 12662 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:35:23.562865 12684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.563136 12662 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:23.563235 12662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "83f7a6fcb1ba4cde88ec47722d5c1370"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "0357d4ee474ae955397f08ffe7f323c6"
server_key_iv: "edcca7f6b49f28f8df8299b92a9253c8"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.563333 12662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:23.583745 12662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:23.586195 12662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:23.586387 12662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:23.586642 12662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:23.587003 12662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:23.587057 12662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.587100 12662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:23.587126 12662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.595618 12662 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46371
I20260811 02:35:23.595681 12895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46371 every 8 connection(s)
I20260811 02:35:23.596027 12662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:23.605562 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 12662
I20260811 02:35:23.605672 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:35:23.605881 17724 external_mini_cluster.cc:1428] Setting key 297dfec46d60c37f135522d5cdd909ec
I20260811 02:35:23.608155 12387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.596898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:50833 (local address 127.17.79.62:45767)
0811 02:35:23.597015 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.597018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.597282 (+ 264us) server_negotiation.cc:407] Connection header received
0811 02:35:23.598120 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.598121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.598132 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.598193 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:23.599670 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.600229 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.602013 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.602224 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.602362 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.604878 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:23.604880 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:23.604880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:23.604888 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:23.606788 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.607195 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.607196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.607196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.607255 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.607517 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.607518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.607518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.607636 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:23.607712 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.607986 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.608069 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 02:35:23.608345 12901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.596855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:50833)
0811 02:35:23.597106 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:23.597162 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:23.597972 (+ 810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:23.598299 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:23.598304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:23.599242 (+ 938us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:23.599548 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.599556 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.600329 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.600330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.601894 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.601898 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.602376 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.602377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.602545 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.603093 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:23.603104 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:23.604776 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:23.606867 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:23.606874 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:23.606877 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:23.607107 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:23.607322 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:23.607323 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:23.607324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:23.607434 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:23.607703 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:23.607710 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:23.607848 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 02:35:23.607953 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 02:35:23.608121 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":145,"threads_started":1}
I20260811 02:35:23.608920 12897 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45767
I20260811 02:35:23.609037 12897 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:23.609218 12897 heartbeater.cc:511] Master 127.17.79.62:45767 requested a full tablet report, sending...
I20260811 02:35:23.609705 12319 ts_manager.cc:194] Registered new tserver with Master: 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371)
I20260811 02:35:23.610262 12319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:50833
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:35:23.641813 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45767
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:23.735860 12906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:23.736119 12906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:23.736161 12906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:23.737311 12906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:23.737385 12906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:23.737437 12906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:35:23.739038 12906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:23.739318 12906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:23.739566 12906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:23.744987 12914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:23.744966 12916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:23.744971 12919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:23.745249 12906 server_base.cc:1034] running on GCE node
I20260811 02:35:23.745455 12906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:23.745714 12906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:23.746908 12906 hybrid_clock.cc:648] HybridClock initialized: now 1786415723746895 us; error 29 us; skew 500 ppm
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:23.749639 12906 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:35:23.750159 12906 webserver.cc:460] Webserver started at http://127.17.79.3:33227/ using document root <none> and password file <none>
I20260811 02:35:23.750424 12906 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:23.750509 12906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:23.750690 12906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:35:23.751886 12906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "e04ab4b1074743d98083f38976963d6a"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "8465e22850c79bd1a203d86134305e29"
server_key_iv: "1ece7d297680904f0fc969398ebca26b"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.752302 12906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "e04ab4b1074743d98083f38976963d6a"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "8465e22850c79bd1a203d86134305e29"
server_key_iv: "1ece7d297680904f0fc969398ebca26b"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.753842 12906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:35:23.756902 12934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.757210 12906 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 02:35:23.757332 12906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "e04ab4b1074743d98083f38976963d6a"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "8465e22850c79bd1a203d86134305e29"
server_key_iv: "1ece7d297680904f0fc969398ebca26b"
server_key_version: "encryptionkey@0"
I20260811 02:35:23.757436 12906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:23.809186 12906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:23.811782 12906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:23.811964 12906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:23.812235 12906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:23.812580 12906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:23.812646 12906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.812696 12906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:23.812721 12906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:23.819052 12906 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39129
I20260811 02:35:23.819176 13148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39129 every 8 connection(s)
I20260811 02:35:23.819473 12906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:35:23.822345 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 12906
I20260811 02:35:23.822444 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:35:23.822621 17724 external_mini_cluster.cc:1428] Setting key ae4fc8027aedb1fb8829f24b1e1a7403
Aug 11 02:35:23 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415723, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:23.829759 12387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.820382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:36025 (local address 127.17.79.62:45767)
0811 02:35:23.820450 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.820452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.820515 (+ 63us) server_negotiation.cc:407] Connection header received
0811 02:35:23.821078 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.821080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.821094 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.821173 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:23.822550 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.823287 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.824359 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.824574 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.824663 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.826914 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:23.826915 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:23.826916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:23.826924 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:23.828327 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.828766 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.828767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.828768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.828833 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.829095 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.829096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.829096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.829223 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:23.829299 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.829585 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.829670 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 02:35:23.829985 13152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.820201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:36025)
0811 02:35:23.820381 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:23.820425 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:23.820913 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:23.821469 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:23.821474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:23.822069 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:23.822415 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.822423 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.823401 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.823402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.824263 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.824266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.824677 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.824679 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.824811 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.825322 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:23.825332 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:23.826812 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:23.828439 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:23.828447 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:23.828449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:23.828683 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:23.828909 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:23.828909 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:23.828910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:23.829015 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:23.829300 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:23.829309 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:23.829446 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 02:35:23.829550 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 02:35:23.829721 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260811 02:35:23.830549 13149 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45767
I20260811 02:35:23.830634 13149 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:23.830775 13149 heartbeater.cc:511] Master 127.17.79.62:45767 requested a full tablet report, sending...
I20260811 02:35:23.831113 12319 ts_manager.cc:194] Registered new tserver with Master: e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
I20260811 02:35:23.831494 12319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:36025
I20260811 02:35:23.834376 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:35:23.841702 12387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.835726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57138 (local address 127.17.79.62:45767)
0811 02:35:23.835765 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.835767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.835899 (+ 132us) server_negotiation.cc:407] Connection header received
0811 02:35:23.835925 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.835926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.835935 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.835981 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:23.836525 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.836986 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.837694 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.837870 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.837925 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.839136 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:23.839138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:23.839138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:23.839144 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:23.840559 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.840889 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.840889 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.840890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.840938 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:23.841127 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:23.841127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:23.841128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:23.841263 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:23.841338 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.841521 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.841581 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:35:23.843259 12319 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:35:23.844800 12319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:35:23.851361 13179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.847468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41842 (local address 127.17.79.3:39129)
0811 02:35:23.847648 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.847652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.847661 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:35:23.847701 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.847703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.847714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.847801 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:23.848056 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.848793 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.850366 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.850943 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.851045 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.851116 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.851234 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.851275 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260811 02:35:23.851361 13177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.847197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39129 (local address 127.0.0.1:41842)
0811 02:35:23.847534 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:23.847542 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:23.847581 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:23.847892 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:23.847895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:23.847898 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:23.847973 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.847975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.848897 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.848898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.850279 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.850282 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.851048 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.851049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.851129 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.851145 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 02:35:23.851219 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 02:35:23.851263 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":119,"threads_started":1}
I20260811 02:35:23.851682 13183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.847483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47930 (local address 127.17.79.2:46371)
0811 02:35:23.847914 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.847918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.847927 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:35:23.847966 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.847968 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.847981 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.848091 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:23.848213 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.849301 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.850332 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.850971 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.851464 (+ 493us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.851535 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.851561 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.851599 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":79,"threads_started":1}
I20260811 02:35:23.851423 13171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.847168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46371 (local address 127.0.0.1:47930)
0811 02:35:23.847329 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:23.847368 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:23.847434 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:23.848094 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:23.848095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:23.848105 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:23.848150 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.848151 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.849439 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.849441 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.850177 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.850180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.851077 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.851078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.851148 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.851153 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:35:23.851193 (+ 40us) client_negotiation.cc:240] Negotiation successful
0811 02:35:23.851248 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260811 02:35:23.851934 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.847665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32894 (local address 127.17.79.1:37397)
0811 02:35:23.847850 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:23.847855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:23.847867 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:35:23.847910 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:23.847913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:23.847929 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:23.848183 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:23.848259 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.849309 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.850602 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.851315 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.851704 (+ 389us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.851777 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:23.851804 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 02:35:23.851852 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":110,"threads_started":1}
I20260811 02:35:23.851632 13175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:23.847197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37397 (local address 127.0.0.1:32894)
0811 02:35:23.847355 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:23.847368 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:23.847434 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:23.848051 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:23.848052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:23.848055 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:23.848102 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.848104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.849418 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.849419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.850517 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:23.850519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:23.851410 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:23.851411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:23.851489 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:23.851493 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:35:23.851525 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 02:35:23.851564 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":27,"thread_start_us":91,"threads_started":1}
I20260811 02:35:23.852651 12773 tablet_service.cc:1467] Processing CreateTablet for tablet 82342f2be7e64779a08bf6c9ce4f996b (DEFAULT_TABLE table=test-table [id=84117e8a899d4d6aa2ee6d205d45fc1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:23.852656 13029 tablet_service.cc:1467] Processing CreateTablet for tablet 82342f2be7e64779a08bf6c9ce4f996b (DEFAULT_TABLE table=test-table [id=84117e8a899d4d6aa2ee6d205d45fc1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:23.853000 13029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82342f2be7e64779a08bf6c9ce4f996b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:23.853011 12773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82342f2be7e64779a08bf6c9ce4f996b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:23.855897 13186 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Bootstrap starting.
I20260811 02:35:23.855930 13188 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Bootstrap starting.
I20260811 02:35:23.856583 13186 tablet_bootstrap.cc:654] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:23.856469 12536 tablet_service.cc:1467] Processing CreateTablet for tablet 82342f2be7e64779a08bf6c9ce4f996b (DEFAULT_TABLE table=test-table [id=84117e8a899d4d6aa2ee6d205d45fc1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:23.856638 13188 tablet_bootstrap.cc:654] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:23.856858 12536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82342f2be7e64779a08bf6c9ce4f996b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:23.857146 13186 log.cc:824] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:23.857226 13188 log.cc:824] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:23.857926 13186 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: No bootstrap required, opened a new log
I20260811 02:35:23.858016 13186 ts_tablet_manager.cc:1397] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:23.858014 13188 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: No bootstrap required, opened a new log
I20260811 02:35:23.858081 13188 ts_tablet_manager.cc:1397] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:23.859611 13186 raft_consensus.cc:348] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:23.859777 13186 raft_consensus.cc:374] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:23.859823 13186 raft_consensus.cc:729] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04ab4b1074743d98083f38976963d6a, State: Initialized, Role: FOLLOWER
I20260811 02:35:23.859933 13186 consensus_queue.cc:260] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:23.860229 13186 ts_tablet_manager.cc:1428] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:23.860355 13196 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Bootstrap starting.
I20260811 02:35:23.860394 13149 heartbeater.cc:503] Master 127.17.79.62:45767 was elected leader, sending a full tablet report...
I20260811 02:35:23.860291 13188 raft_consensus.cc:348] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:23.860459 13188 raft_consensus.cc:374] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:23.860507 13188 raft_consensus.cc:729] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f7a6fcb1ba4cde88ec47722d5c1370, State: Initialized, Role: FOLLOWER
I20260811 02:35:23.860630 13188 consensus_queue.cc:260] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:23.860924 13188 ts_tablet_manager.cc:1428] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:35:23.861188 12897 heartbeater.cc:503] Master 127.17.79.62:45767 was elected leader, sending a full tablet report...
I20260811 02:35:23.861296 13196 tablet_bootstrap.cc:654] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:23.861934 13196 log.cc:824] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:23.862763 13196 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: No bootstrap required, opened a new log
I20260811 02:35:23.862857 13196 ts_tablet_manager.cc:1397] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:35:23.864202 13196 raft_consensus.cc:348] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:23.864351 13196 raft_consensus.cc:374] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:23.864398 13196 raft_consensus.cc:729] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6538f72204e24c899521addd6b469b2b, State: Initialized, Role: FOLLOWER
I20260811 02:35:23.864504 13196 consensus_queue.cc:260] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:23.864768 13196 ts_tablet_manager.cc:1428] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:23.864809 12654 heartbeater.cc:503] Master 127.17.79.62:45767 was elected leader, sending a full tablet report...
W20260811 02:35:23.926625 12655 tablet.cc:2369] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:35:24.070186 13151 tablet.cc:2369] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:35:24.070382 13195 raft_consensus.cc:482] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:24.070539 13195 raft_consensus.cc:504] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:24.070983 13195 leader_election.cc:288] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397)
I20260811 02:35:24.074059 13183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:24.071286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:36265 (local address 127.17.79.2:46371)
0811 02:35:24.071333 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:24.071336 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:24.071347 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:35:24.071407 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:24.071408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:24.071419 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:24.071488 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:24.071669 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.072187 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.073162 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.073708 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.073788 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:24.073799 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:24.073955 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 02:35:24.073995 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:35:24.074059 13152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:24.071206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46371 (local address 127.17.79.3:36265)
0811 02:35:24.071266 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:24.071280 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:24.071333 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:24.071507 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:24.071508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:24.071509 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:24.071587 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:24.071589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.072286 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.072288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:24.073041 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:24.073043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.073786 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.073787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:24.073868 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:24.073874 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:35:24.073948 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 02:35:24.073988 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":2}
I20260811 02:35:24.074177 13206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:24.071224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37397 (local address 127.17.79.3:53779)
0811 02:35:24.071390 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:24.071400 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:24.071492 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:24.071651 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:24.071652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:24.071653 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:24.071723 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:24.071725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.072336 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.072337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:24.073160 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:24.073162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.073884 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.073886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:24.073968 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:24.073972 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:35:24.074051 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 02:35:24.074092 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":116,"threads_started":1}
I20260811 02:35:24.074167 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:24.071268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:53779 (local address 127.17.79.1:37397)
0811 02:35:24.071319 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:24.071322 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:24.071478 (+ 156us) server_negotiation.cc:407] Connection header received
0811 02:35:24.071551 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:24.071552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:24.071564 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:24.071646 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:24.071800 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.072256 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.073245 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.073780 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.073869 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:24.073881 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:24.074058 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 02:35:24.074101 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:35:24.074558 12566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82342f2be7e64779a08bf6c9ce4f996b" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6538f72204e24c899521addd6b469b2b" is_pre_election: true
I20260811 02:35:24.074558 12806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82342f2be7e64779a08bf6c9ce4f996b" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" is_pre_election: true
I20260811 02:35:24.074719 12566 raft_consensus.cc:2454] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 0.
I20260811 02:35:24.074719 12806 raft_consensus.cc:2454] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 0.
I20260811 02:35:24.074949 12942 leader_election.cc:302] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6538f72204e24c899521addd6b469b2b, e04ab4b1074743d98083f38976963d6a; no voters:
I20260811 02:35:24.075063 13195 raft_consensus.cc:2781] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:35:24.075125 13195 raft_consensus.cc:482] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:35:24.075148 13195 raft_consensus.cc:3037] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:24.075870 13195 raft_consensus.cc:504] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:24.076027 13195 leader_election.cc:288] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 election: Requested vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397)
I20260811 02:35:24.076169 12806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82342f2be7e64779a08bf6c9ce4f996b" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370"
I20260811 02:35:24.076238 12566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82342f2be7e64779a08bf6c9ce4f996b" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6538f72204e24c899521addd6b469b2b"
I20260811 02:35:24.076256 12806 raft_consensus.cc:3037] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:24.076311 12566 raft_consensus.cc:3037] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:24.077144 12566 raft_consensus.cc:2454] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 1.
I20260811 02:35:24.077149 12806 raft_consensus.cc:2454] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 1.
I20260811 02:35:24.077368 12942 leader_election.cc:302] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6538f72204e24c899521addd6b469b2b, e04ab4b1074743d98083f38976963d6a; no voters:
I20260811 02:35:24.077456 13195 raft_consensus.cc:2781] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:35:24.077618 13195 raft_consensus.cc:686] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 1 LEADER]: Becoming Leader. State: Replica: e04ab4b1074743d98083f38976963d6a, State: Running, Role: LEADER
I20260811 02:35:24.077728 13195 consensus_queue.cc:237] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:24.078711 12318 catalog_manager.cc:5495] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a reported cstate change: term changed from 0 to 1, leader changed from <none> to e04ab4b1074743d98083f38976963d6a (127.17.79.3). New cstate: current_term: 1 leader_uuid: "e04ab4b1074743d98083f38976963d6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } health_report { overall_health: HEALTHY } } }
W20260811 02:35:24.096833 12900 tablet.cc:2369] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:35:24.134814 13179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:24.132184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41858 (local address 127.17.79.3:39129)
0811 02:35:24.132262 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:24.132269 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:24.132277 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:35:24.132323 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:24.132324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:24.132346 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:24.132427 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:35:24.132545 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.133016 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.133935 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:24.134156 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:24.134233 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:24.134431 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:35:24.134544 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:35:24.134646 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:24.134669 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 02:35:24.134692 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 02:35:24.137014 12566 raft_consensus.cc:1261] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Refusing update from remote peer e04ab4b1074743d98083f38976963d6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:24.137025 12806 raft_consensus.cc:1261] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Refusing update from remote peer e04ab4b1074743d98083f38976963d6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:24.137415 13208 consensus_queue.cc:1035] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:24.137559 13195 consensus_queue.cc:1035] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:24.140208 13215 mvcc.cc:205] Tried to move back new op lower bound from 7317158806062051328 to 7317158805823000576. Current Snapshot: MvccSnapshot[applied={T|T < 7317158806062051328}]
I20260811 02:35:24.142453 12319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:24.142553 12319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:24.143494 12319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Sending DeleteTablet for 3 replicas of tablet 82342f2be7e64779a08bf6c9ce4f996b
I20260811 02:35:24.143853 13029 tablet_service.cc:1514] Processing DeleteTablet for tablet 82342f2be7e64779a08bf6c9ce4f996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:24 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:41842
I20260811 02:35:24.143854 12773 tablet_service.cc:1514] Processing DeleteTablet for tablet 82342f2be7e64779a08bf6c9ce4f996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:24 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:47930
I20260811 02:35:24.143993 12536 tablet_service.cc:1514] Processing DeleteTablet for tablet 82342f2be7e64779a08bf6c9ce4f996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:24 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:32894
I20260811 02:35:24.144248 13233 tablet_replica.cc:330] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: stopping tablet replica
I20260811 02:35:24.144356 13233 raft_consensus.cc:2229] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:24.144395 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 12422
I20260811 02:35:24.155766 13227 tablet_replica.cc:330] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: stopping tablet replica
I20260811 02:35:24.155948 13227 raft_consensus.cc:2229] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:24.156097 13227 raft_consensus.cc:2258] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:24.156312 13232 tablet_replica.cc:330] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: stopping tablet replica
I20260811 02:35:24.156424 13232 raft_consensus.cc:2229] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:35:24.156525 13232 raft_consensus.cc:2258] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:24.159386 13227 ts_tablet_manager.cc:1905] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:24.159412 13232 ts_tablet_manager.cc:1905] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:24.161263 13232 ts_tablet_manager.cc:1918] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:24.161386 13232 log.cc:1196] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/82342f2be7e64779a08bf6c9ce4f996b
I20260811 02:35:24.161708 13232 ts_tablet_manager.cc:1939] T 82342f2be7e64779a08bf6c9ce4f996b P e04ab4b1074743d98083f38976963d6a: Deleting consensus metadata
I20260811 02:35:24.161844 13227 ts_tablet_manager.cc:1918] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:24.162034 13227 log.cc:1196] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/82342f2be7e64779a08bf6c9ce4f996b
I20260811 02:35:24.162218 12298 catalog_manager.cc:4841] TS e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): tablet 82342f2be7e64779a08bf6c9ce4f996b (table test-table [id=84117e8a899d4d6aa2ee6d205d45fc1d]) successfully deleted
I20260811 02:35:24.162484 13227 ts_tablet_manager.cc:1939] T 82342f2be7e64779a08bf6c9ce4f996b P 83f7a6fcb1ba4cde88ec47722d5c1370: Deleting consensus metadata
I20260811 02:35:24.162930 12294 catalog_manager.cc:4841] TS 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): tablet 82342f2be7e64779a08bf6c9ce4f996b (table test-table [id=84117e8a899d4d6aa2ee6d205d45fc1d]) successfully deleted
W20260811 02:35:24.164132 12299 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:37397 (error 108)
I20260811 02:35:24.164758 13177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:24.164598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37397 (local address 127.0.0.1:32902)
0811 02:35:24.164663 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:24.164709 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:37397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 02:35:24.164866 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 12662
W20260811 02:35:24.205124 12299 catalog_manager.cc:4584] TS 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82342f2be7e64779a08bf6c9ce4f996b: Network error: Client connection negotiation failed: client connection to 127.17.79.1:37397: connect: Connection refused (error 111)
I20260811 02:35:24.214409 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 12906
I20260811 02:35:24.235445 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 12268
I20260811 02:35:44.252738 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45767
--webserver_interface=127.17.79.62
--webserver_port=38009
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:35:44.340411 13236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:44.340853 13236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:44.340946 13236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:44.343030 13236 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 02:35:44.343103 13236 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 02:35:44.343130 13236 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 02:35:44.343183 13236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:35:44.343216 13236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:44.343242 13236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:44.343292 13236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:35:44.343322 13236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:35:44.344872 13236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=38009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:44.345177 13236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:44.345464 13236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:44.356858 13248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:44.356753 13245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:44.356753 13244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:44.357028 13236 server_base.cc:1034] running on GCE node
I20260811 02:35:44.357317 13236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:44.357717 13236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:44.358901 13236 hybrid_clock.cc:648] HybridClock initialized: now 1786415744358875 us; error 43 us; skew 500 ppm
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:44.362656 13236 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:35:44.363250 13236 webserver.cc:460] Webserver started at http://127.17.79.62:38009/ using document root <none> and password file <none>
I20260811 02:35:44.363581 13236 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:44.363672 13236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:44.365825 13236 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:35:44.366711 13260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.366923 13236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:44.367045 13236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "7c3e9292caeb4b5fbe41ddda40f53150"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "49491072a4b5d0c4c280e80c8bd9c5c5"
server_key_iv: "35bf6a8fea24c65f3e935e1814eb06a3"
server_key_version: "encryptionkey@0"
I20260811 02:35:44.367470 13236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:44.393275 13236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:44.395517 13236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:44.395700 13236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:44.400219 13236 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:45767
I20260811 02:35:44.400295 13359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:45767 every 8 connection(s)
I20260811 02:35:44.400691 13236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:35:44.402323 13361 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:35:44.403041 13361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Bootstrap starting.
I20260811 02:35:44.409662 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 13236
I20260811 02:35:44.410001 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:37397
--local_ip_for_outbound_sockets=127.17.79.1
--tserver_master_addrs=127.17.79.62:45767
--webserver_port=40515
--webserver_interface=127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:35:44.412348 13361 log.cc:824] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:44.414858 13361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:35:44.415220 13361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Bootstrap complete.
I20260811 02:35:44.417649 13361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:44.417920 13361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c3e9292caeb4b5fbe41ddda40f53150, State: Initialized, Role: FOLLOWER
I20260811 02:35:44.418150 13361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:44.418277 13361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:35:44.418347 13361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:35:44.418402 13361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 1 FOLLOWER]: Advancing to term 2
I20260811 02:35:44.419495 13361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:44.419632 13361 leader_election.cc:302] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c3e9292caeb4b5fbe41ddda40f53150; no voters:
I20260811 02:35:44.419865 13361 leader_election.cc:288] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 02:35:44.419910 13367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 02:35:44.420048 13367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 LEADER]: Becoming Leader. State: Replica: 7c3e9292caeb4b5fbe41ddda40f53150, State: Running, Role: LEADER
I20260811 02:35:44.420145 13367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:35:44.420176 13361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:35:44.420519 13369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } } }
I20260811 02:35:44.420692 13369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:44.420960 13382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:35:44.420516 13367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c3e9292caeb4b5fbe41ddda40f53150. Latest consensus state: current_term: 2 leader_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } } }
I20260811 02:35:44.421180 13367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: This master's current role is: LEADER
I20260811 02:35:44.421897 13382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:35:44.422026 13382 catalog_manager.cc:1259] Loaded cluster ID: 5f0187c2875a4568b3f86db92a07cffd
I20260811 02:35:44.422073 13382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:35:44.423381 13382 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:35:44.423611 13382 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Loaded TSK: 0
I20260811 02:35:44.436486 13382 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Generated new TSK 1
I20260811 02:35:44.436630 13382 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 02:35:44.526167 13363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:44.526468 13363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:44.526532 13363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:44.527670 13363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:44.527745 13363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:44.527793 13363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:35:44.529304 13363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:37397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=40515
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:44.529594 13363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:44.529848 13363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:44.535145 13407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:44.535218 13414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:44.535439 13363 server_base.cc:1034] running on GCE node
W20260811 02:35:44.535488 13409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:44.535728 13363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:44.536010 13363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:44.537286 13363 hybrid_clock.cc:648] HybridClock initialized: now 1786415744537267 us; error 34 us; skew 500 ppm
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:44.539855 13363 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:35:44.540374 13363 webserver.cc:460] Webserver started at http://127.17.79.1:40515/ using document root <none> and password file <none>
I20260811 02:35:44.540635 13363 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:44.540694 13363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:44.542109 13363 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:44.542853 13429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.543056 13363 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:44.543156 13363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "6538f72204e24c899521addd6b469b2b"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "fb65b0305bc482b43cd71c1201ba6d35"
server_key_iv: "46de74cc69799344fa2eaa2c8e097809"
server_key_version: "encryptionkey@0"
I20260811 02:35:44.543483 13363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:44.570211 13363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:44.572786 13363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:44.572943 13363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:44.573244 13363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:44.573743 13440 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 02:35:44.575721 13363 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 02:35:44.575806 13363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 02:35:44.575847 13363 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 02:35:44.576520 13363 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 02:35:44.576566 13363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:44.576692 13440 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Bootstrap starting.
I20260811 02:35:44.584623 13363 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:37397
I20260811 02:35:44.585168 13363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:35:44.585752 13629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:37397 every 8 connection(s)
I20260811 02:35:44.586946 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 13363
I20260811 02:35:44.587291 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:46371
--local_ip_for_outbound_sockets=127.17.79.2
--tserver_master_addrs=127.17.79.62:45767
--webserver_port=46289
--webserver_interface=127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:35:44.588886 13440 log.cc:824] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:44.593070 13440 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:44.593429 13440 tablet_bootstrap.cc:492] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Bootstrap complete.
I20260811 02:35:44.594867 13440 ts_tablet_manager.cc:1397] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.011s
I20260811 02:35:44.596542 13440 raft_consensus.cc:348] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:44.596953 13440 raft_consensus.cc:729] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6538f72204e24c899521addd6b469b2b, State: Initialized, Role: FOLLOWER
I20260811 02:35:44.597105 13440 consensus_queue.cc:260] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } }
I20260811 02:35:44.597282 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.586287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:47389 (local address 127.17.79.62:45767)
0811 02:35:44.587178 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.587187 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.587224 (+ 37us) server_negotiation.cc:407] Connection header received
0811 02:35:44.587455 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.587461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.587514 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.588291 (+ 777us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:44.588350 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.589700 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.590936 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.591369 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.591505 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.593835 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:44.593841 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:44.593845 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:44.593855 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:44.595560 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.595992 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.595994 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.595995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.596075 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.596336 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.596338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.596338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.596551 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:44.596650 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.596934 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.597072 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":824,"thread_start_us":93,"threads_started":1}
I20260811 02:35:44.597412 13440 ts_tablet_manager.cc:1428] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260811 02:35:44.597760 13632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.585880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:47389)
0811 02:35:44.586301 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:44.586346 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:44.586923 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:44.587708 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:44.587713 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:44.587996 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:44.588191 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.588196 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.589847 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.589848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.590826 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.590829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.591493 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.591495 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.591628 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.592199 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:44.592208 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:44.593729 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:44.595651 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.595659 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.595661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.595888 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.596148 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.596148 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.596149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.596265 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.596628 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:44.596635 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:44.596773 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 02:35:44.596883 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 02:35:44.597305 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":87,"threads_started":1}
I20260811 02:35:44.598544 13630 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45767
I20260811 02:35:44.598647 13630 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:44.598826 13630 heartbeater.cc:511] Master 127.17.79.62:45767 requested a full tablet report, sending...
I20260811 02:35:44.599558 13296 ts_manager.cc:194] Registered new tserver with Master: 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397)
I20260811 02:35:44.600656 13296 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:47389
I20260811 02:35:44.601558 13630 heartbeater.cc:503] Master 127.17.79.62:45767 was elected leader, sending a full tablet report...
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.1@KRBTEST.COM
I20260811 02:35:44.608820 13642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.600163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37397 (local address 127.0.0.1:53542)
0811 02:35:44.600327 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:44.600374 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:44.600448 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:44.601268 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:44.601275 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:44.601592 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:44.601645 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.601647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.602930 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.602931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.603482 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.603484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.604066 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.604067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.604118 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.604571 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:44.604575 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:44.605807 (+ 1232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:44.607811 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.607817 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.607818 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.608000 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.608219 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.608220 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.608220 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.608273 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.608562 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:44.608568 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:44.608607 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 02:35:44.608669 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 02:35:44.608753 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260811 02:35:44.608883 13644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.600952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53542 (local address 127.17.79.1:37397)
0811 02:35:44.601116 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.601120 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.601130 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:35:44.601162 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.601165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.601178 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.601252 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:44.601741 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.602846 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.603558 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.603992 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.604061 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.605888 (+ 1827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:44.605896 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:44.605896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:44.605903 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:44.607728 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.608081 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.608084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.608084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.608147 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.608336 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.608337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.608337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.608496 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:44.608578 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.608701 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.608791 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260811 02:35:44.609297 13479 tablet_service.cc:1514] Processing DeleteTablet for tablet 82342f2be7e64779a08bf6c9ce4f996b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:24 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:53542
I20260811 02:35:44.609869 13648 tablet_replica.cc:330] stopping tablet replica
I20260811 02:35:44.609952 13648 raft_consensus.cc:2229] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:44.610038 13648 raft_consensus.cc:2258] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:44.610384 13648 ts_tablet_manager.cc:1905] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:44.612581 13648 ts_tablet_manager.cc:1918] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:44.612643 13648 log.cc:1196] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal/wals/82342f2be7e64779a08bf6c9ce4f996b
I20260811 02:35:44.612890 13648 ts_tablet_manager.cc:1939] T 82342f2be7e64779a08bf6c9ce4f996b P 6538f72204e24c899521addd6b469b2b: Deleting consensus metadata
I20260811 02:35:44.613395 13267 catalog_manager.cc:4841] TS 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397): tablet 82342f2be7e64779a08bf6c9ce4f996b (table test-table [id=84117e8a899d4d6aa2ee6d205d45fc1d]) successfully deleted
W20260811 02:35:44.677567 13637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:44.677809 13637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:44.677847 13637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:44.678987 13637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:44.679052 13637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:44.679096 13637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:35:44.680593 13637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:46371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=46289
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:44.680886 13637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:44.681125 13637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:44.686206 13659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:44.686213 13662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:44.686309 13658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:44.686443 13637 server_base.cc:1034] running on GCE node
I20260811 02:35:44.686764 13637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:44.687000 13637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:44.688169 13637 hybrid_clock.cc:648] HybridClock initialized: now 1786415744688127 us; error 44 us; skew 500 ppm
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:44.690698 13637 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:35:44.691087 13637 webserver.cc:460] Webserver started at http://127.17.79.2:46289/ using document root <none> and password file <none>
I20260811 02:35:44.691296 13637 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:44.691352 13637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:44.692700 13637 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:35:44.693307 13673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.693493 13637 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:44.693588 13637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "83f7a6fcb1ba4cde88ec47722d5c1370"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "0357d4ee474ae955397f08ffe7f323c6"
server_key_iv: "edcca7f6b49f28f8df8299b92a9253c8"
server_key_version: "encryptionkey@0"
I20260811 02:35:44.693908 13637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:44.706916 13637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:44.709331 13637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:44.709448 13637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:44.709641 13637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:44.709971 13637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:44.710005 13637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.710028 13637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:44.710043 13637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.716136 13637 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46371
I20260811 02:35:44.716219 13886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46371 every 8 connection(s)
I20260811 02:35:44.716600 13637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:44.724859 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 13637
I20260811 02:35:44.725503 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:39129
--local_ip_for_outbound_sockets=127.17.79.3
--tserver_master_addrs=127.17.79.62:45767
--webserver_port=33227
--webserver_interface=127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:35:44.726445 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.717393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:54759 (local address 127.17.79.62:45767)
0811 02:35:44.717475 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.717478 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.717657 (+ 179us) server_negotiation.cc:407] Connection header received
0811 02:35:44.718144 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.718145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.718163 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.718216 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:44.719185 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.719676 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.720799 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.721001 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.721056 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.723257 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:44.723259 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:44.723259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:44.723269 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:44.724524 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.724951 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.724953 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.724953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.725036 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.725638 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.725639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.725640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.725764 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:44.725844 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.726195 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.726344 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 02:35:44.726653 13892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.717340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:54759)
0811 02:35:44.717527 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:44.717564 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:44.718038 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:44.718334 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:44.718337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:44.718897 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:44.719084 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.719088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.719765 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.719766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.720726 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.720728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.721077 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.721078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.721196 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.721689 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:44.721697 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:44.723140 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:44.724614 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.724622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.724625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.724865 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.725410 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.725411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.725412 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.725546 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.725833 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:44.725841 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:44.725983 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 02:35:44.726160 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 02:35:44.726420 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260811 02:35:44.727777 13887 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45767
I20260811 02:35:44.727890 13887 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:44.728096 13887 heartbeater.cc:511] Master 127.17.79.62:45767 requested a full tablet report, sending...
I20260811 02:35:44.728610 13296 ts_manager.cc:194] Registered new tserver with Master: 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371)
I20260811 02:35:44.729007 13296 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:54759
W20260811 02:35:44.812230 13893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:35:44.812498 13893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:35:44.812526 13893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:35:44.813663 13893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:35:44.813709 13893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:35:44.813735 13893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:35:44.815347 13893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:39129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=33227
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:35:44.815603 13893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:35:44.815850 13893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:35:44.821301 13911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:35:44.821323 13907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:44.821492 13893 server_base.cc:1034] running on GCE node
W20260811 02:35:44.821323 13908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:35:44.821789 13893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:35:44.822037 13893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:35:44.823215 13893 hybrid_clock.cc:648] HybridClock initialized: now 1786415744823199 us; error 49 us; skew 500 ppm
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:35:44.825992 13893 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:35:44.826494 13893 webserver.cc:460] Webserver started at http://127.17.79.3:33227/ using document root <none> and password file <none>
I20260811 02:35:44.826709 13893 fs_manager.cc:359] Metadata directory not provided
I20260811 02:35:44.826772 13893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:35:44.828058 13893 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:35:44.828637 13921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.828816 13893 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:35:44.828912 13893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "e04ab4b1074743d98083f38976963d6a"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "8465e22850c79bd1a203d86134305e29"
server_key_iv: "1ece7d297680904f0fc969398ebca26b"
server_key_version: "encryptionkey@0"
I20260811 02:35:44.829227 13893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:35:44.840173 13893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:35:44.842458 13893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:35:44.842571 13893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:35:44.842759 13893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:35:44.843075 13893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:35:44.843111 13893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.843132 13893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:35:44.843145 13893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:35:44.849448 13893 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39129
I20260811 02:35:44.849509 14145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39129 every 8 connection(s)
I20260811 02:35:44.849857 13893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:35:44.853050 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 13893
Aug 11 02:35:44 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415744, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:35:44.860070 14157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.853562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46932 (local address 127.17.79.62:45767)
0811 02:35:44.853835 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.853836 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.853842 (+ 6us) server_negotiation.cc:407] Connection header received
0811 02:35:44.853858 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.853859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.853868 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.853938 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:44.854634 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.855115 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.855885 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.856078 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.856151 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.857452 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:44.857454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:44.857454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:44.857462 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:44.858915 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.859276 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.859278 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.859278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.859337 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.859540 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.859541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.859542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.859658 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:44.859841 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.859882 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.859959 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":65,"threads_started":1}
I20260811 02:35:44.860965 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.850694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:57207 (local address 127.17.79.62:45767)
0811 02:35:44.850788 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.850790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.851044 (+ 254us) server_negotiation.cc:407] Connection header received
0811 02:35:44.851555 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.851556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.851574 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.851653 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:44.852749 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.853294 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.854623 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.854848 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.854948 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.857481 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:44.857483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:44.857483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:44.857506 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:44.859258 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.859725 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.859726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.859726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.859794 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.860084 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.860085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.860085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.860274 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:44.860337 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.860701 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.860878 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 02:35:44.861105 14153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.850661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:57207)
0811 02:35:44.850884 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:44.850919 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:44.851440 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:44.851784 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:44.851788 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:44.852412 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:35:44.852628 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.852633 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.853426 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.853428 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.854510 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.854514 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.854961 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.854962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.855099 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.855711 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:35:44.855719 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:35:44.857359 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:35:44.859371 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.859379 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.859381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.859626 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.859869 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:35:44.859870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:35:44.859871 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:35:44.859991 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:35:44.860348 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:35:44.860355 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:35:44.860537 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 02:35:44.860677 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 02:35:44.860855 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":137,"threads_started":1}
I20260811 02:35:44.861582 14147 heartbeater.cc:347] Connected to a master server at 127.17.79.62:45767
I20260811 02:35:44.861680 14147 heartbeater.cc:464] Registering TS with master...
I20260811 02:35:44.861876 14147 heartbeater.cc:511] Master 127.17.79.62:45767 requested a full tablet report, sending...
I20260811 02:35:44.862332 13296 ts_manager.cc:194] Registered new tserver with Master: e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
I20260811 02:35:44.862697 13296 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:57207
I20260811 02:35:44.872020 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:35:44.874976 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.872577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46942 (local address 127.17.79.62:45767)
0811 02:35:44.872622 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.872624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.872759 (+ 135us) server_negotiation.cc:407] Connection header received
0811 02:35:44.872811 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.872812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.872847 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.872908 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:35:44.873027 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.873497 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.874368 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.874545 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.874598 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.874734 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:35:44.874776 (+ 42us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 02:35:44.874899 (+ 123us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46942: token expired
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 02:35:44.875036 13635 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46942: token expired
W20260811 02:35:44.875124 13153 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.79.62:45767)
I20260811 02:35:44.881116 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.875343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46958 (local address 127.17.79.62:45767)
0811 02:35:44.875384 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.875386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.875406 (+ 20us) server_negotiation.cc:407] Connection header received
0811 02:35:44.875454 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.875454 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.875461 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.875503 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:35:44.875951 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.876374 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.877018 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.877198 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.877252 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.878679 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:35:44.878680 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:35:44.878680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:35:44.878686 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:35:44.880077 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.880426 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.880427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.880427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.880479 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:35:44.880652 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:35:44.880653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:35:44.880653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:35:44.880749 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:35:44.880824 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.880940 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.880995 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:35:44.882365 13296 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46958:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:35:44.884207 13296 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:35:44.886418 13479 tablet_service.cc:1467] Processing CreateTablet for tablet 185a4f76472148c395d7b3c95aad8975 (DEFAULT_TABLE table=test-table [id=08d7ad53230745349d81c4b8521cf7a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:44.886629 13479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 185a4f76472148c395d7b3c95aad8975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:44.888200 13440 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Bootstrap starting.
I20260811 02:35:44.888542 13440 tablet_bootstrap.cc:654] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:44.889142 13440 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: No bootstrap required, opened a new log
I20260811 02:35:44.889199 13440 ts_tablet_manager.cc:1397] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 02:35:44.889572 13440 raft_consensus.cc:348] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:44.889664 13440 raft_consensus.cc:374] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:44.889706 13440 raft_consensus.cc:729] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6538f72204e24c899521addd6b469b2b, State: Initialized, Role: FOLLOWER
I20260811 02:35:44.889758 13440 consensus_queue.cc:260] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:44.889848 13440 ts_tablet_manager.cc:1428] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 02:35:44.890166 14159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.886156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39129 (local address 127.0.0.1:55728)
0811 02:35:44.886460 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:44.886471 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:44.886523 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:44.886853 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:44.886854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:44.886855 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:44.886881 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.886881 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.887762 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.887763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.889042 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.889043 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.889873 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.889874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.889960 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.889983 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 02:35:44.890041 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 02:35:44.890082 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":65,"threads_started":1}
I20260811 02:35:44.890314 13642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.886090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46371 (local address 127.0.0.1:46136)
0811 02:35:44.886139 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:44.886150 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:44.886188 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:44.886644 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:44.886645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:44.886647 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:44.886692 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.886693 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.887938 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.887939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.889009 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:44.889011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.890016 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.890017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:44.890081 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.890084 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:35:44.890132 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 02:35:44.890177 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 02:35:44.890313 14160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.886214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.17.79.2:46371)
0811 02:35:44.886463 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.886468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.886479 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:35:44.886521 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.886523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.886539 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.886641 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:44.886746 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.887852 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.889126 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.889873 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.889989 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.890049 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.890156 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.890190 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":157,"threads_started":1}
I20260811 02:35:44.890501 14161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:44.886400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55728 (local address 127.17.79.3:39129)
0811 02:35:44.886607 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:44.886610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:44.886621 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:35:44.886671 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:44.886674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:44.886690 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:44.886769 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:44.886963 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.887673 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.889127 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:44.889709 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:44.889777 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:44.889837 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:44.890378 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 02:35:44.890419 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":99,"threads_started":1}
I20260811 02:35:44.891134 14011 tablet_service.cc:1467] Processing CreateTablet for tablet 185a4f76472148c395d7b3c95aad8975 (DEFAULT_TABLE table=test-table [id=08d7ad53230745349d81c4b8521cf7a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:44.891168 13773 tablet_service.cc:1467] Processing CreateTablet for tablet 185a4f76472148c395d7b3c95aad8975 (DEFAULT_TABLE table=test-table [id=08d7ad53230745349d81c4b8521cf7a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:35:44.891494 14011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 185a4f76472148c395d7b3c95aad8975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:44.891499 13773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 185a4f76472148c395d7b3c95aad8975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:35:44.894045 14164 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Bootstrap starting.
I20260811 02:35:44.894357 14168 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Bootstrap starting.
I20260811 02:35:44.894740 14164 tablet_bootstrap.cc:654] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:44.894945 14168 tablet_bootstrap.cc:654] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Neither blocks nor log segments found. Creating new log.
I20260811 02:35:44.895301 14164 log.cc:824] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:44.895486 14168 log.cc:824] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Log is configured to *not* fsync() on all Append() calls
I20260811 02:35:44.896106 14164 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: No bootstrap required, opened a new log
I20260811 02:35:44.896183 14164 ts_tablet_manager.cc:1397] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:35:44.896253 14168 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: No bootstrap required, opened a new log
I20260811 02:35:44.896317 14168 ts_tablet_manager.cc:1397] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 02:35:44.898173 14164 raft_consensus.cc:348] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:44.898176 14168 raft_consensus.cc:348] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:44.898386 14164 raft_consensus.cc:374] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:44.898386 14168 raft_consensus.cc:374] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:35:44.898428 14164 raft_consensus.cc:729] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f7a6fcb1ba4cde88ec47722d5c1370, State: Initialized, Role: FOLLOWER
I20260811 02:35:44.898428 14168 raft_consensus.cc:729] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e04ab4b1074743d98083f38976963d6a, State: Initialized, Role: FOLLOWER
I20260811 02:35:44.898540 14168 consensus_queue.cc:260] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:44.898540 14164 consensus_queue.cc:260] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:44.898831 14168 ts_tablet_manager.cc:1428] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 02:35:44.898825 14164 ts_tablet_manager.cc:1428] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:35:44.898869 13887 heartbeater.cc:503] Master 127.17.79.62:45767 was elected leader, sending a full tablet report...
I20260811 02:35:44.898942 14147 heartbeater.cc:503] Master 127.17.79.62:45767 was elected leader, sending a full tablet report...
W20260811 02:35:44.967223 13889 tablet.cc:2369] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:35:45.086056 13631 tablet.cc:2369] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:35:45.089357 14175 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:35:45.089510 14175 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:45.089908 14175 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397)
I20260811 02:35:45.093009 14153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:45.090173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46371 (local address 127.17.79.3:55451)
0811 02:35:45.090277 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:45.090292 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:45.090381 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:45.090608 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:45.090610 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:45.090611 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:45.090694 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:45.090696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.091352 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.091353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:45.092146 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:45.092149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.092731 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.092732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:45.092815 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:45.092817 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:35:45.092895 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 02:35:45.092938 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 02:35:45.093009 14160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:45.090340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:55451 (local address 127.17.79.2:46371)
0811 02:35:45.090483 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:45.090485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:45.090492 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:35:45.090516 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:45.090517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:45.090528 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:45.090588 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:45.090772 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.091259 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.092258 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.092639 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.092730 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:45.092749 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:45.092905 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 02:35:45.092944 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260811 02:35:45.093153 13644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:45.090319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:44039 (local address 127.17.79.1:37397)
0811 02:35:45.090387 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:45.090389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:45.090648 (+ 259us) server_negotiation.cc:407] Connection header received
0811 02:35:45.090721 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:45.090722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:45.090752 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:45.090828 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:35:45.090994 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.091502 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.092415 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.092816 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.092905 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:45.092974 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:45.093054 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 02:35:45.093089 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:35:45.093169 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:45.090173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37397 (local address 127.17.79.3:44039)
0811 02:35:45.090567 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:45.090578 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:35:45.090662 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:35:45.090833 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:35:45.090834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:35:45.090835 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:35:45.090910 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:45.090916 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.091598 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.091599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:45.092320 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:35:45.092322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.092906 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.092907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:35:45.092975 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:45.092980 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:35:45.093040 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 02:35:45.093082 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":191,"thread_start_us":117,"threads_started":1}
I20260811 02:35:45.093458 13540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "185a4f76472148c395d7b3c95aad8975" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6538f72204e24c899521addd6b469b2b" is_pre_election: true
I20260811 02:35:45.093612 13540 raft_consensus.cc:2454] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 0.
I20260811 02:35:45.093596 13809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "185a4f76472148c395d7b3c95aad8975" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" is_pre_election: true
I20260811 02:35:45.093751 13809 raft_consensus.cc:2454] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 0.
I20260811 02:35:45.093837 13929 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6538f72204e24c899521addd6b469b2b, e04ab4b1074743d98083f38976963d6a; no voters:
I20260811 02:35:45.093982 14175 raft_consensus.cc:2781] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:35:45.094053 14175 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:35:45.094079 14175 raft_consensus.cc:3037] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:45.094887 14175 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:45.095147 14175 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 election: Requested vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397)
I20260811 02:35:45.095332 13540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "185a4f76472148c395d7b3c95aad8975" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6538f72204e24c899521addd6b469b2b"
I20260811 02:35:45.095330 13809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "185a4f76472148c395d7b3c95aad8975" candidate_uuid: "e04ab4b1074743d98083f38976963d6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370"
I20260811 02:35:45.095418 13540 raft_consensus.cc:3037] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:45.095422 13809 raft_consensus.cc:3037] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:35:45.096325 13540 raft_consensus.cc:2454] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 1.
I20260811 02:35:45.096490 13809 raft_consensus.cc:2454] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e04ab4b1074743d98083f38976963d6a in term 1.
I20260811 02:35:45.096848 13929 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6538f72204e24c899521addd6b469b2b, e04ab4b1074743d98083f38976963d6a; no voters:
W20260811 02:35:45.100423 14151 tablet.cc:2369] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:35:45.102877 14175 raft_consensus.cc:2781] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:35:45.103075 14175 raft_consensus.cc:686] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 1 LEADER]: Becoming Leader. State: Replica: e04ab4b1074743d98083f38976963d6a, State: Running, Role: LEADER
I20260811 02:35:45.103178 14175 consensus_queue.cc:237] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:35:45.104130 13295 catalog_manager.cc:5495] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a reported cstate change: term changed from 0 to 1, leader changed from <none> to e04ab4b1074743d98083f38976963d6a (127.17.79.3). New cstate: current_term: 1 leader_uuid: "e04ab4b1074743d98083f38976963d6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260811 02:35:45.123008 14161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:45.120458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.17.79.3:39129)
0811 02:35:45.120523 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 02:35:45.120525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:35:45.120536 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:35:45.120617 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:35:45.120618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:35:45.120643 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:35:45.120741 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:35:45.120884 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.121426 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.122164 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:35:45.122390 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:35:45.122471 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:35:45.122642 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:35:45.122756 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:35:45.122856 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 02:35:45.122875 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 02:35:45.122897 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 02:35:45.124946 13540 raft_consensus.cc:1261] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Refusing update from remote peer e04ab4b1074743d98083f38976963d6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:45.124946 13809 raft_consensus.cc:1261] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Refusing update from remote peer e04ab4b1074743d98083f38976963d6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:35:45.125371 14175 consensus_queue.cc:1035] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:45.125541 14180 consensus_queue.cc:1035] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:35:45.127871 14186 mvcc.cc:205] Tried to move back new op lower bound from 7317158892028502016 to 7317158891943370752. Current Snapshot: MvccSnapshot[applied={T|T < 7317158892028502016 or (T in {7317158892028502016})}]
I20260811 02:35:45.130556 13296 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:45.130640 13296 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:35:45.131436 13296 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Sending DeleteTablet for 3 replicas of tablet 185a4f76472148c395d7b3c95aad8975
I20260811 02:35:45.131786 13479 tablet_service.cc:1514] Processing DeleteTablet for tablet 185a4f76472148c395d7b3c95aad8975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:45 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:53542
I20260811 02:35:45.131808 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 13363
I20260811 02:35:45.131774 13773 tablet_service.cc:1514] Processing DeleteTablet for tablet 185a4f76472148c395d7b3c95aad8975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:45 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:46136
I20260811 02:35:45.146837 14195 tablet_replica.cc:330] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: stopping tablet replica
I20260811 02:35:45.147001 14195 raft_consensus.cc:2229] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:35:45.147167 14195 raft_consensus.cc:2258] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:45.149267 14195 ts_tablet_manager.cc:1905] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:45.151098 14195 ts_tablet_manager.cc:1918] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:45.151167 14195 log.cc:1196] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/185a4f76472148c395d7b3c95aad8975
I20260811 02:35:45.151427 14195 ts_tablet_manager.cc:1939] T 185a4f76472148c395d7b3c95aad8975 P 83f7a6fcb1ba4cde88ec47722d5c1370: Deleting consensus metadata
I20260811 02:35:45.152422 13262 catalog_manager.cc:4841] TS 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): tablet 185a4f76472148c395d7b3c95aad8975 (table test-table [id=08d7ad53230745349d81c4b8521cf7a4]) successfully deleted
I20260811 02:35:45.156523 14011 tablet_service.cc:1514] Processing DeleteTablet for tablet 185a4f76472148c395d7b3c95aad8975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:35:45 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:55728
I20260811 02:35:45.157804 14197 tablet_replica.cc:330] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: stopping tablet replica
I20260811 02:35:45.157965 14197 raft_consensus.cc:2229] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:35:45.158108 14197 raft_consensus.cc:2258] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:35:45.158602 14197 ts_tablet_manager.cc:1905] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:35:45.160218 14197 ts_tablet_manager.cc:1918] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:35:45.160313 14197 log.cc:1196] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/185a4f76472148c395d7b3c95aad8975
I20260811 02:35:45.160593 14197 ts_tablet_manager.cc:1939] T 185a4f76472148c395d7b3c95aad8975 P e04ab4b1074743d98083f38976963d6a: Deleting consensus metadata
I20260811 02:35:45.161031 13265 catalog_manager.cc:4841] TS e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): tablet 185a4f76472148c395d7b3c95aad8975 (table test-table [id=08d7ad53230745349d81c4b8521cf7a4]) successfully deleted
W20260811 02:35:45.163076 13267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:37397 (error 108)
I20260811 02:35:45.163380 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 13637
I20260811 02:35:45.163587 13642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:35:45.163457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:37397 (local address 127.0.0.1:53554)
0811 02:35:45.163514 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 02:35:45.163549 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:37397: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 02:35:45.170099 13267 catalog_manager.cc:4584] TS 6538f72204e24c899521addd6b469b2b (127.17.79.1:37397): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 185a4f76472148c395d7b3c95aad8975: Network error: Client connection negotiation failed: client connection to 127.17.79.1:37397: connect: Connection refused (error 111)
I20260811 02:35:45.204808 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 13893
I20260811 02:35:45.221202 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 13236
I20260811 02:36:05.234606 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45767
--webserver_interface=127.17.79.62
--webserver_port=38009
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:05.321687 14200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:05.321898 14200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:05.321921 14200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:05.323124 14200 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 02:36:05.323167 14200 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 02:36:05.323180 14200 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 02:36:05.323192 14200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:05.323206 14200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:05.323220 14200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:05.323280 14200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:05.323298 14200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:05.324906 14200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=38009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:05.325188 14200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:05.325448 14200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:05.331066 14215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.331049 14211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.331278 14210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:05.331391 14200 server_base.cc:1034] running on GCE node
I20260811 02:36:05.331717 14200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:05.332052 14200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:05.333232 14200 hybrid_clock.cc:648] HybridClock initialized: now 1786415765333198 us; error 50 us; skew 500 ppm
Aug 11 02:36:05 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415765, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:05.336156 14200 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:05.336656 14200 webserver.cc:460] Webserver started at http://127.17.79.62:38009/ using document root <none> and password file <none>
I20260811 02:36:05.336921 14200 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:05.336992 14200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:05.338773 14200 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:05.339620 14233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.339804 14200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:05.339916 14200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "7c3e9292caeb4b5fbe41ddda40f53150"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "49491072a4b5d0c4c280e80c8bd9c5c5"
server_key_iv: "35bf6a8fea24c65f3e935e1814eb06a3"
server_key_version: "encryptionkey@0"
I20260811 02:36:05.340302 14200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:05.351882 14200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:05.353935 14200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:05.354108 14200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:05.358707 14200 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:45767
I20260811 02:36:05.359197 14326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:45767 every 8 connection(s)
I20260811 02:36:05.359432 14200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:05.361634 14331 sys_catalog.cc:263] Verifying existing consensus state
I20260811 02:36:05.361651 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 14200
I20260811 02:36:05.361945 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:37397
--local_ip_for_outbound_sockets=127.17.79.1
--tserver_master_addrs=127.17.79.62:45767
--webserver_port=40515
--webserver_interface=127.17.79.1
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:36:05.362776 14331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Bootstrap starting.
I20260811 02:36:05.374294 14331 log.cc:824] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:05.378062 14331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:36:05.378412 14331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: Bootstrap complete.
I20260811 02:36:05.382277 14331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:36:05.382859 14331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c3e9292caeb4b5fbe41ddda40f53150, State: Initialized, Role: FOLLOWER
I20260811 02:36:05.383178 14331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:36:05.383273 14331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:05.383323 14331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:05.383374 14331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 2 FOLLOWER]: Advancing to term 3
I20260811 02:36:05.384846 14331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:36:05.384971 14331 leader_election.cc:302] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c3e9292caeb4b5fbe41ddda40f53150; no voters:
I20260811 02:36:05.385169 14331 leader_election.cc:288] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 02:36:05.385206 14336 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 02:36:05.385334 14336 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [term 3 LEADER]: Becoming Leader. State: Replica: 7c3e9292caeb4b5fbe41ddda40f53150, State: Running, Role: LEADER
I20260811 02:36:05.385423 14336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } }
I20260811 02:36:05.385489 14331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:05.385720 14336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c3e9292caeb4b5fbe41ddda40f53150. Latest consensus state: current_term: 3 leader_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } } }
I20260811 02:36:05.385800 14336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:05.385730 14339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c3e9292caeb4b5fbe41ddda40f53150" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45767 } } }
I20260811 02:36:05.385977 14339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:05.387491 14360 catalog_manager.cc:1259] Loaded cluster ID: 5f0187c2875a4568b3f86db92a07cffd
I20260811 02:36:05.387545 14360 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: loading cluster ID for follower catalog manager: success
I20260811 02:36:05.388777 14360 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7c3e9292caeb4b5fbe41ddda40f53150: acquiring CA information for follower catalog manager: success
F20260811 02:36:05.389163 14360 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7faf89ca59ad google::LogMessage::Fail() at ??:0
@ 0x7faf89ca888a google::LogMessage::SendToLog() at ??:0
@ 0x7faf89ca54de google::LogMessage::Flush() at ??:0
@ 0x7faf89ca6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7faf8c412104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7faf91bfe6b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7faf91bfe989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7faf91bfee4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7faf91c018c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7faf8bb68954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7faf8c9cc6db start_thread at ??:0
@ 0x7faf887a361f clone at ??:0
W20260811 02:36:05.489537 14333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:05.489820 14333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:05.489856 14333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:05.491212 14333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:05.491261 14333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:05.491290 14333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:36:05.492794 14333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:37397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=40515
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:05.493036 14333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:05.493314 14333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:05.498479 14406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.498487 14412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.498487 14409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:05.499037 14333 server_base.cc:1034] running on GCE node
I20260811 02:36:05.499250 14333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:05.499504 14333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:05.500676 14333 hybrid_clock.cc:648] HybridClock initialized: now 1786415765500658 us; error 37 us; skew 500 ppm
Aug 11 02:36:05 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415765, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:05.503314 14333 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:36:05.503803 14333 webserver.cc:460] Webserver started at http://127.17.79.1:40515/ using document root <none> and password file <none>
I20260811 02:36:05.504066 14333 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:05.504141 14333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:05.505579 14333 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:05.506438 14423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.506623 14333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:05.506719 14333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "6538f72204e24c899521addd6b469b2b"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "fb65b0305bc482b43cd71c1201ba6d35"
server_key_iv: "46de74cc69799344fa2eaa2c8e097809"
server_key_version: "encryptionkey@0"
I20260811 02:36:05.507117 14333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:05.526222 14333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:05.528682 14333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:05.528867 14333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:05.529186 14333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:05.529675 14439 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 02:36:05.531747 14333 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 02:36:05.531822 14333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 02:36:05.531869 14333 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 02:36:05.532549 14333 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 02:36:05.532606 14333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 02:36:05.532689 14439 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Bootstrap starting.
I20260811 02:36:05.540246 14333 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:37397
I20260811 02:36:05.540654 14333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:36:05.544267 14439 log.cc:824] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:05.544660 14627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:37397 every 8 connection(s)
I20260811 02:36:05.547137 14439 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 02:36:05.547473 14439 tablet_bootstrap.cc:492] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Bootstrap complete.
I20260811 02:36:05.548759 14439 ts_tablet_manager.cc:1397] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260811 02:36:05.549345 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 14333
I20260811 02:36:05.549631 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:46371
--local_ip_for_outbound_sockets=127.17.79.2
--tserver_master_addrs=127.17.79.62:45767
--webserver_port=46289
--webserver_interface=127.17.79.2
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:36:05.550136 14439 raft_consensus.cc:348] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:05.550493 14439 raft_consensus.cc:729] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6538f72204e24c899521addd6b469b2b, State: Initialized, Role: FOLLOWER
I20260811 02:36:05.550669 14439 consensus_queue.cc:260] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:05.550954 14439 ts_tablet_manager.cc:1428] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260811 02:36:05.640304 14632 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:36:05.541373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:45791)
0811 02:36:05.541559 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.541603 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:05.542059 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:05.640052 (+ 97993us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":111,"threads_started":1}
W20260811 02:36:05.640609 14628 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:45767 (0 consecutive failures): Network error: Failed to ping master at 127.17.79.62:45767: Client connection negotiation failed: client connection to 127.17.79.62:45767: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 02:36:05.640980 14632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.640853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:40711)
0811 02:36:05.640910 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.640950 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 02:36:05.641409 14632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.641318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:52863)
0811 02:36:05.641368 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.641393 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 02:36:05.641543 14628 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 02:36:05.659487 14639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:05.659727 14639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:05.659770 14639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:05.660931 14639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:05.661000 14639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:05.661046 14639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:36:05.662596 14639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:46371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=46289
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:05.662850 14639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:05.663079 14639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:05.668344 14646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.668457 14650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.668396 14647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:05.668542 14639 server_base.cc:1034] running on GCE node
I20260811 02:36:05.668913 14639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:05.669369 14639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:05.670569 14639 hybrid_clock.cc:648] HybridClock initialized: now 1786415765670551 us; error 41 us; skew 500 ppm
Aug 11 02:36:05 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415765, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:05.673281 14639 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:36:05.673686 14639 webserver.cc:460] Webserver started at http://127.17.79.2:46289/ using document root <none> and password file <none>
I20260811 02:36:05.673883 14639 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:05.673925 14639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:05.675284 14639 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:05.675921 14663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.676137 14639 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:05.676232 14639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "83f7a6fcb1ba4cde88ec47722d5c1370"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "0357d4ee474ae955397f08ffe7f323c6"
server_key_iv: "edcca7f6b49f28f8df8299b92a9253c8"
server_key_version: "encryptionkey@0"
I20260811 02:36:05.676620 14639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:05.703159 14639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:05.705726 14639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:05.705844 14639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:05.706048 14639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:05.706429 14639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:05.706468 14639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.706491 14639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:05.706540 14639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.712889 14639 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:46371
I20260811 02:36:05.712941 14884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:46371 every 8 connection(s)
I20260811 02:36:05.713285 14639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:36:05.714478 14890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.713981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:54973)
0811 02:36:05.714183 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.714317 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":101,"threads_started":1}
W20260811 02:36:05.714910 14885 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:45767 (0 consecutive failures): Network error: Failed to ping master at 127.17.79.62:45767: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
I20260811 02:36:05.715248 14890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.715118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:36865)
0811 02:36:05.715196 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.715227 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 02:36:05.715624 14890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.715545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:44757)
0811 02:36:05.715585 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.715608 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 02:36:05.715749 14885 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 02:36:05.716917 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 14639
I20260811 02:36:05.717197 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:39129
--local_ip_for_outbound_sockets=127.17.79.3
--tserver_master_addrs=127.17.79.62:45767
--webserver_port=33227
--webserver_interface=127.17.79.3
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:33201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:05.802731 14891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:05.802994 14891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:05.803040 14891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:05.804268 14891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:05.804339 14891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:05.804386 14891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:36:05.805929 14891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:33201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:39129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=33227
--tserver_master_addrs=127.17.79.62:45767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:05.806223 14891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:05.806507 14891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:36:05.812273 14891 server_base.cc:1034] running on GCE node
W20260811 02:36:05.812319 14907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.812321 14900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:05.812415 14903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:05.812776 14891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:05.813077 14891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:05.814311 14891 hybrid_clock.cc:648] HybridClock initialized: now 1786415765814261 us; error 70 us; skew 500 ppm
Aug 11 02:36:05 dist-test-slave-7nm7 krb5kdc[12246](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415765, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:05.817104 14891 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:36:05.817607 14891 webserver.cc:460] Webserver started at http://127.17.79.3:33227/ using document root <none> and password file <none>
I20260811 02:36:05.818090 14891 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:05.818163 14891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:05.819809 14891 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:05.820639 14917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.820943 14891 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:05.821089 14891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "e04ab4b1074743d98083f38976963d6a"
format_stamp: "Formatted at 2026-08-11 02:35:23 on dist-test-slave-7nm7"
server_key: "8465e22850c79bd1a203d86134305e29"
server_key_iv: "1ece7d297680904f0fc969398ebca26b"
server_key_version: "encryptionkey@0"
I20260811 02:36:05.821470 14891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:05.840958 14891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:05.843817 14891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:05.844014 14891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:05.844293 14891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:05.844696 14891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:05.844776 14891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.844821 14891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:05.844849 14891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:05.851665 14891 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:39129
I20260811 02:36:05.851802 15106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:39129 every 8 connection(s)
I20260811 02:36:05.852142 14891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:36:05.853618 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 14891
I20260811 02:36:05.853946 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.853090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:38189)
0811 02:36:05.853423 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.853508 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":88,"threads_started":1}
W20260811 02:36:05.854413 15107 heartbeater.cc:644] Failed to heartbeat to 127.17.79.62:45767 (0 consecutive failures): Network error: Failed to ping master at 127.17.79.62:45767: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
I20260811 02:36:05.854863 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.854732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:35973)
0811 02:36:05.854802 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.854839 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 02:36:05.855310 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:05.855218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:37859)
0811 02:36:05.855268 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:05.855294 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 02:36:05.855479 15107 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 02:36:06.642148 15113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:06.641898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:57511)
0811 02:36:06.642029 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:06.642071 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260811 02:36:06.716328 15114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:06.716109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:49729)
0811 02:36:06.716237 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:06.716273 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260811 02:36:06.777390 15115 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:06.777522 15115 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:06.777812 15115 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
Aug 11 02:36:06 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415765, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.2@KRBTEST.COM
Aug 11 02:36:06 dist-test-slave-7nm7 krb5kdc[12246](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415765, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.3@KRBTEST.COM
I20260811 02:36:06.789324 15113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:06.778052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:39129 (local address 127.17.79.1:42035)
0811 02:36:06.778148 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:06.778161 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:06.778224 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:06.779339 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:06.779342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:06.779817 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:06.780009 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:06.780015 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.781178 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.781180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:06.781975 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:06.781977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.782738 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.782740 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:06.782796 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:06.783585 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:06.783589 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:06.785461 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:06.787725 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:06.787732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:06.787736 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:06.787955 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:06.788224 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:06.788225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:06.788225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:06.788344 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:06.788757 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:06.788765 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:06.788913 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 02:36:06.789024 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 02:36:06.789198 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":7}
I20260811 02:36:06.789335 15119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:06.778052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:46371 (local address 127.17.79.1:40385)
0811 02:36:06.778578 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:06.778590 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:06.778662 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:06.779354 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:06.779355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:06.779818 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:06.780015 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:06.780017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.781297 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.781298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:06.781975 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:06.781977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.782674 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.782675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:06.782791 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:06.783511 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:06.783522 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:06.785122 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:06.788042 (+ 2920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:06.788042 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:06.788043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:06.788182 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:06.788473 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:06.788474 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:06.788475 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:06.788534 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:06.789073 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:06.789074 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:06.789111 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 02:36:06.789165 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 02:36:06.789244 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":346,"thread_start_us":50,"threads_started":1}
I20260811 02:36:06.789660 15117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:06.778367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:40385 (local address 127.17.79.2:46371)
0811 02:36:06.778490 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:06.778501 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:06.778670 (+ 169us) server_negotiation.cc:407] Connection header received
0811 02:36:06.779167 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:06.779169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:06.779208 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:06.779357 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:06.780146 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.781022 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.782081 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.782570 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.782697 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:06.785241 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:06.785245 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:06.785246 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:06.785258 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:06.787628 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:06.788292 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:06.788296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:06.788296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:06.788391 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:06.788619 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:06.788621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:06.788621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:06.788950 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:06.789029 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:06.789261 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 02:36:06.789399 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":63,"threads_started":1}
I20260811 02:36:06.789784 15116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:06.778224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:42035 (local address 127.17.79.3:39129)
0811 02:36:06.778396 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:06.778409 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:06.778435 (+ 26us) server_negotiation.cc:407] Connection header received
0811 02:36:06.779082 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:06.779085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:06.779143 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:06.779303 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:06.780149 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.781039 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.782122 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:06.782628 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:06.782777 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:06.785566 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:06.785570 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:06.785571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:06.785582 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:06.787620 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:06.788036 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:06.788038 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:06.788038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:06.788141 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:06.788419 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:06.788420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:06.788420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:06.788678 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:06.788777 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:06.789518 (+ 741us) server_negotiation.cc:299] Negotiation successful
0811 02:36:06.789672 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
W20260811 02:36:06.790637 14424 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
W20260811 02:36:06.790738 14427 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
I20260811 02:36:06.790807 14427 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6538f72204e24c899521addd6b469b2b; no voters: 83f7a6fcb1ba4cde88ec47722d5c1370, e04ab4b1074743d98083f38976963d6a
I20260811 02:36:06.790907 15115 raft_consensus.cc:2726] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:36:06.856117 15120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:06.855858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:60683)
0811 02:36:06.856025 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:06.856077 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
I20260811 02:36:07.642977 15122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:07.642720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:45917)
0811 02:36:07.642881 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:07.642928 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":70,"threads_started":1}
I20260811 02:36:07.717100 15123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:07.716859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:36649)
0811 02:36:07.717004 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:07.717044 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":64,"threads_started":1}
I20260811 02:36:07.856848 15125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:07.856607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:56799)
0811 02:36:07.856749 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:07.856788 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":66,"threads_started":1}
I20260811 02:36:08.643816 15126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:08.643525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:60045)
0811 02:36:08.643726 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:08.643768 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":92,"threads_started":1}
I20260811 02:36:08.717936 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:08.717689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:45265)
0811 02:36:08.717847 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:08.717889 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":89,"threads_started":1}
I20260811 02:36:08.857678 15129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:08.857461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:46293)
0811 02:36:08.857594 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:08.857634 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260811 02:36:08.869727 15133 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:08.869851 15133 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:08.870075 15133 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
W20260811 02:36:08.870632 14424 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
W20260811 02:36:08.870723 14427 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
I20260811 02:36:08.870769 14427 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6538f72204e24c899521addd6b469b2b; no voters: 83f7a6fcb1ba4cde88ec47722d5c1370, e04ab4b1074743d98083f38976963d6a
I20260811 02:36:08.870846 15133 raft_consensus.cc:2726] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:36:09.644682 15136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:09.644424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:55053)
0811 02:36:09.644591 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:09.644631 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":83,"threads_started":1}
I20260811 02:36:09.718730 15139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:09.718497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:36869)
0811 02:36:09.718647 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:09.718684 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":68,"threads_started":1}
I20260811 02:36:09.858425 15143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:09.858162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:37545)
0811 02:36:09.858343 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:09.858378 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":118,"threads_started":1}
I20260811 02:36:10.566694 15144 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:10.566795 15144 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:10.566973 15144 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
W20260811 02:36:10.567399 14424 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
W20260811 02:36:10.567482 14427 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
I20260811 02:36:10.567515 14427 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6538f72204e24c899521addd6b469b2b; no voters: 83f7a6fcb1ba4cde88ec47722d5c1370, e04ab4b1074743d98083f38976963d6a
I20260811 02:36:10.567613 15144 raft_consensus.cc:2726] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:36:10.645504 15145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:10.645259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:54535)
0811 02:36:10.645421 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:10.645457 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":79,"threads_started":1}
I20260811 02:36:10.719542 15147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:10.719291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:44875)
0811 02:36:10.719439 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:10.719480 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":65,"threads_started":1}
I20260811 02:36:10.859223 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:10.858975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:40679)
0811 02:36:10.859132 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:10.859174 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":82,"threads_started":1}
I20260811 02:36:11.646341 15150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:11.646011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:39533)
0811 02:36:11.646180 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:11.646274 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":122,"threads_started":1}
I20260811 02:36:11.720363 15153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:11.720090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:52673)
0811 02:36:11.720255 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:11.720307 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":96,"threads_started":1}
I20260811 02:36:11.860091 15155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:11.859851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:51637)
0811 02:36:11.859982 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:11.860024 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260811 02:36:12.088984 15156 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:12.089103 15156 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:12.089418 15156 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
W20260811 02:36:12.089882 14427 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
W20260811 02:36:12.089937 14424 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
I20260811 02:36:12.090035 14424 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6538f72204e24c899521addd6b469b2b; no voters: 83f7a6fcb1ba4cde88ec47722d5c1370, e04ab4b1074743d98083f38976963d6a
I20260811 02:36:12.090126 15156 raft_consensus.cc:2726] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:36:12.647228 15159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:12.646947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:53151)
0811 02:36:12.647134 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:12.647177 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":71,"threads_started":1}
I20260811 02:36:12.721174 15162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:12.720918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:44013)
0811 02:36:12.721063 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:12.721129 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
I20260811 02:36:12.860893 15164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:12.860651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:48225)
0811 02:36:12.860802 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:12.860844 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260811 02:36:13.648015 15165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:13.647752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:53661)
0811 02:36:13.647921 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:13.647965 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":69,"threads_started":1}
I20260811 02:36:13.721974 15166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:13.721695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:52097)
0811 02:36:13.721876 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:13.721926 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":91,"threads_started":1}
I20260811 02:36:13.861742 15168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:13.861463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:54895)
0811 02:36:13.861647 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:13.861692 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
I20260811 02:36:14.648869 15169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:14.648620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:56259)
0811 02:36:14.648776 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:14.648819 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260811 02:36:14.722738 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:14.722514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:49549)
0811 02:36:14.722651 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:14.722690 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260811 02:36:14.862665 15172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:14.862421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:57555)
0811 02:36:14.862565 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:14.862606 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260811 02:36:15.649717 15174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:15.649473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:49045)
0811 02:36:15.649622 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:15.649669 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
I20260811 02:36:15.723500 15175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:15.723247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:57419)
0811 02:36:15.723408 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:15.723451 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
I20260811 02:36:15.863507 15176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:15.863228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:44337)
0811 02:36:15.863404 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:15.863453 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":100,"threads_started":1}
I20260811 02:36:16.199255 15177 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:16.199374 15177 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:16.199612 15177 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
W20260811 02:36:16.200085 14427 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
W20260811 02:36:16.200203 14424 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
I20260811 02:36:16.200266 14424 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6538f72204e24c899521addd6b469b2b; no voters: 83f7a6fcb1ba4cde88ec47722d5c1370, e04ab4b1074743d98083f38976963d6a
I20260811 02:36:16.200733 15177 raft_consensus.cc:2726] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:36:16.650722 15178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:16.650445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:37971)
0811 02:36:16.650625 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:16.650668 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":88,"threads_started":1}
I20260811 02:36:16.724423 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:16.724068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:46773)
0811 02:36:16.724257 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:16.724328 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":101,"threads_started":1}
I20260811 02:36:16.864217 15183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:16.863963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:47927)
0811 02:36:16.864133 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:16.864170 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":106,"threads_started":1}
I20260811 02:36:17.651789 15187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:17.651509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:55539)
0811 02:36:17.651692 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:17.651736 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":96,"threads_started":1}
I20260811 02:36:17.725396 15189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:17.724988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:58243)
0811 02:36:17.725307 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:17.725348 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":207,"threads_started":1}
I20260811 02:36:17.865104 15190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:17.864816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:40865)
0811 02:36:17.865001 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:17.865045 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":87,"threads_started":1}
I20260811 02:36:18.652683 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:18.652425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:49303)
0811 02:36:18.652576 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:18.652628 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260811 02:36:18.726140 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:18.725896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:39591)
0811 02:36:18.726054 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:18.726094 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":86,"threads_started":1}
I20260811 02:36:18.865792 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:18.865563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:58635)
0811 02:36:18.865710 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:18.865747 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":82,"threads_started":1}
I20260811 02:36:19.166020 15194 raft_consensus.cc:482] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:19.166143 15194 raft_consensus.cc:504] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83f7a6fcb1ba4cde88ec47722d5c1370" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 46371 } } peers { permanent_uuid: "e04ab4b1074743d98083f38976963d6a" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 39129 } } peers { permanent_uuid: "6538f72204e24c899521addd6b469b2b" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 37397 } }
I20260811 02:36:19.166379 15194 leader_election.cc:288] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371), e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129)
W20260811 02:36:19.166793 14427 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e04ab4b1074743d98083f38976963d6a (127.17.79.3:39129): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
W20260811 02:36:19.166893 14424 leader_election.cc:341] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83f7a6fcb1ba4cde88ec47722d5c1370 (127.17.79.2:46371): Not found: Tablet not found: 185a4f76472148c395d7b3c95aad8975
I20260811 02:36:19.166971 14424 leader_election.cc:302] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6538f72204e24c899521addd6b469b2b; no voters: 83f7a6fcb1ba4cde88ec47722d5c1370, e04ab4b1074743d98083f38976963d6a
I20260811 02:36:19.167126 15194 raft_consensus.cc:2726] T 185a4f76472148c395d7b3c95aad8975 P 6538f72204e24c899521addd6b469b2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 02:36:19.653441 15195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:19.653170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:34973)
0811 02:36:19.653356 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:19.653393 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":102,"threads_started":1}
I20260811 02:36:19.726897 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:19.726672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:36787)
0811 02:36:19.726802 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:19.726848 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260811 02:36:19.866616 15204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:19.866372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:32965)
0811 02:36:19.866527 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:19.866564 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260811 02:36:20.654395 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:20.654105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.1:53103)
0811 02:36:20.654303 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:20.654345 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":74,"threads_started":1}
I20260811 02:36:20.727710 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:20.727462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.2:59033)
0811 02:36:20.727612 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:20.727657 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
I20260811 02:36:20.859447 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 14333
I20260811 02:36:20.868605 15210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:20.867384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45767 (local address 127.17.79.3:39545)
0811 02:36:20.868511 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:20.868548 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.62:45767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1106,"thread_start_us":1078,"threads_started":1}
I20260811 02:36:20.874006 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 14639
I20260811 02:36:20.887071 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 14891
2026-08-11T02:36:20Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59214 ms)
[----------] 30 tests from SecurityITest (245495 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:20 dist-test-slave-7nm7 krb5kdc[15216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:20 dist-test-slave-7nm7 krb5kdc[15216](info): set up 2 sockets
Aug 11 02:36:20 dist-test-slave-7nm7 krb5kdc[15216](info): commencing operation
krb5kdc: starting...
W20260811 02:36:22.193508 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:22.328819 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:38949
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:38949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:22.412379 15235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:22.412576 15235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:22.412598 15235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:22.413795 15235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:22.413838 15235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:22.413853 15235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:22.413865 15235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:22.413877 15235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:22.415396 15235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:38949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:38949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:22.415591 15235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:22.415752 15235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:22.420693 15252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.420787 15243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.420722 15246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:22.420928 15235 server_base.cc:1034] running on GCE node
I20260811 02:36:22.421212 15235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:22.421540 15235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:22.422705 15235 hybrid_clock.cc:648] HybridClock initialized: now 1786415782422685 us; error 45 us; skew 500 ppm
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:22.425390 15235 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:22.425825 15235 webserver.cc:460] Webserver started at http://127.17.79.62:42585/ using document root <none> and password file <none>
I20260811 02:36:22.426050 15235 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:22.426102 15235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:22.426306 15235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:22.427388 15235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "a105d21d7b3a4683850d407177e855ea"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "7685d98f539b2dc074cf2074c58c92c5"
server_key_iv: "19baf565c9d673590071775a42cdca9c"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.427765 15235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "a105d21d7b3a4683850d407177e855ea"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "7685d98f539b2dc074cf2074c58c92c5"
server_key_iv: "19baf565c9d673590071775a42cdca9c"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.429214 15235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:22.430029 15264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.430290 15235 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:22.430410 15235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "a105d21d7b3a4683850d407177e855ea"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "7685d98f539b2dc074cf2074c58c92c5"
server_key_iv: "19baf565c9d673590071775a42cdca9c"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.430505 15235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:22.455535 15235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:22.457944 15235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:22.458117 15235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:22.462180 15235 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:38949
I20260811 02:36:22.462296 15352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:38949 every 8 connection(s)
I20260811 02:36:22.462651 15235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:22.463554 15356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:22.464781 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 15235
I20260811 02:36:22.464888 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:22.465094 17724 external_mini_cluster.cc:1428] Setting key 5caff3a579b107ea5ee50a5eefa6b8ef
I20260811 02:36:22.466320 15356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea: Bootstrap starting.
I20260811 02:36:22.467075 15356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:22.467432 15356 log.cc:824] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:22.468137 15356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea: No bootstrap required, opened a new log
I20260811 02:36:22.470538 15356 raft_consensus.cc:348] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a105d21d7b3a4683850d407177e855ea" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38949 } }
I20260811 02:36:22.470723 15356 raft_consensus.cc:374] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:22.470763 15356 raft_consensus.cc:729] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a105d21d7b3a4683850d407177e855ea, State: Initialized, Role: FOLLOWER
I20260811 02:36:22.470903 15356 consensus_queue.cc:260] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a105d21d7b3a4683850d407177e855ea" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38949 } }
I20260811 02:36:22.470996 15356 raft_consensus.cc:388] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:22.471031 15356 raft_consensus.cc:482] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:22.471086 15356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:22.471786 15356 raft_consensus.cc:504] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a105d21d7b3a4683850d407177e855ea" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38949 } }
I20260811 02:36:22.471876 15356 leader_election.cc:302] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a105d21d7b3a4683850d407177e855ea; no voters:
I20260811 02:36:22.472048 15356 leader_election.cc:288] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:22.472075 15364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 1 FOLLOWER]: Leader election won for term 1
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:22.472204 15364 raft_consensus.cc:686] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [term 1 LEADER]: Becoming Leader. State: Replica: a105d21d7b3a4683850d407177e855ea, State: Running, Role: LEADER
I20260811 02:36:22.472304 15356 sys_catalog.cc:564] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:22.472289 15364 consensus_queue.cc:237] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a105d21d7b3a4683850d407177e855ea" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38949 } }
I20260811 02:36:22.472599 15364 sys_catalog.cc:455] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader a105d21d7b3a4683850d407177e855ea. Latest consensus state: current_term: 1 leader_uuid: "a105d21d7b3a4683850d407177e855ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a105d21d7b3a4683850d407177e855ea" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38949 } } }
I20260811 02:36:22.472663 15364 sys_catalog.cc:458] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:22.472786 15371 sys_catalog.cc:455] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a105d21d7b3a4683850d407177e855ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a105d21d7b3a4683850d407177e855ea" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 38949 } } }
I20260811 02:36:22.473383 15371 sys_catalog.cc:458] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:22.473423 15375 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:22.475157 15375 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:22.476487 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:22.465634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38160 (local address 127.17.79.62:38949)
0811 02:36:22.465825 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:22.465834 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:22.465867 (+ 33us) server_negotiation.cc:407] Connection header received
0811 02:36:22.466337 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:22.466343 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:22.466391 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:22.466540 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:22.467381 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.468374 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.469423 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.469803 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.469879 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:22.472853 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:22.472857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:22.472857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:22.472869 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:22.474747 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:22.475154 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:22.475158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:22.475158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:22.475297 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:22.475519 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:22.475520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:22.475520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:22.475840 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:22.475997 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:22.476132 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 02:36:22.476292 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":106,"threads_started":1}
I20260811 02:36:22.477133 15375 catalog_manager.cc:1347] Generated new cluster ID: 3a23aaade9434adbbce57762d98327a6
I20260811 02:36:22.477183 15375 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:22.498421 15375 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:22.499009 15375 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:22.518209 15375 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea: Generated new TSK 0
I20260811 02:36:22.518493 15375 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:36:22.554900 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38949
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:22.644956 15411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:22.645156 15411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:22.645179 15411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:22.646328 15411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:22.646371 15411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:22.646397 15411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:36:22.647867 15411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:22.648154 15411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:22.648443 15411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:22.653825 15421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.653820 15426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.653828 15423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:22.653949 15411 server_base.cc:1034] running on GCE node
I20260811 02:36:22.654227 15411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:22.654491 15411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:22.655638 15411 hybrid_clock.cc:648] HybridClock initialized: now 1786415782655626 us; error 28 us; skew 500 ppm
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:22.658303 15411 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:36:22.658743 15411 webserver.cc:460] Webserver started at http://127.17.79.1:37251/ using document root <none> and password file <none>
I20260811 02:36:22.658931 15411 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:22.658970 15411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:22.659063 15411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:22.660063 15411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "38cba8fe6d7a41dd8b37f7047432eab9"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "20ff7efdeb5c6e474aa8b9ec7421ed38"
server_key_iv: "d16b279818e468b8823cc5122b74cf91"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.660380 15411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "38cba8fe6d7a41dd8b37f7047432eab9"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "20ff7efdeb5c6e474aa8b9ec7421ed38"
server_key_iv: "d16b279818e468b8823cc5122b74cf91"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.661706 15411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 02:36:22.662523 15439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.662730 15411 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:22.662822 15411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "38cba8fe6d7a41dd8b37f7047432eab9"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "20ff7efdeb5c6e474aa8b9ec7421ed38"
server_key_iv: "d16b279818e468b8823cc5122b74cf91"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.662878 15411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:22.685607 15411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:22.687749 15411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:22.687872 15411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:22.688071 15411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:22.688421 15411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:22.688454 15411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.688477 15411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:22.688525 15411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.694103 15411 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:39701
I20260811 02:36:22.694196 15644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:39701 every 8 connection(s)
I20260811 02:36:22.694559 15411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:22.701061 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 15411
I20260811 02:36:22.701169 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:36:22.701439 17724 external_mini_cluster.cc:1428] Setting key 0ad554d7c176446d608293c65e0bc712
I20260811 02:36:22.704043 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:22.695350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:38897 (local address 127.17.79.62:38949)
0811 02:36:22.695426 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:22.695428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:22.695608 (+ 180us) server_negotiation.cc:407] Connection header received
0811 02:36:22.696078 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:22.696079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:22.696088 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:22.696148 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:22.697054 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.697539 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.698531 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.698735 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.698788 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:22.700914 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:22.700916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:22.700917 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:22.700924 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:22.702633 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:22.703033 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:22.703034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:22.703035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:22.703097 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:22.703354 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:22.703355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:22.703355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:22.703498 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:22.703567 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:22.703809 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 02:36:22.703908 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 02:36:22.704085 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:22.695295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38949 (local address 127.17.79.1:38897)
0811 02:36:22.695479 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:22.695522 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:22.696000 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:22.696214 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:22.696217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:22.696785 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:22.696978 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:22.696982 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.697626 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.697627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:22.698456 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:22.698458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.698808 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.698809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:22.698905 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:22.699434 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:22.699443 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:22.700803 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:22.702718 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:22.702725 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:22.702727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:22.702959 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:22.703170 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:22.703170 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:22.703171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:22.703286 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:22.703564 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:22.703569 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:22.703681 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 02:36:22.703768 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 02:36:22.703888 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260811 02:36:22.704895 15645 heartbeater.cc:347] Connected to a master server at 127.17.79.62:38949
I20260811 02:36:22.705008 15645 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:22.705214 15645 heartbeater.cc:511] Master 127.17.79.62:38949 requested a full tablet report, sending...
I20260811 02:36:22.705782 15286 ts_manager.cc:194] Registered new tserver with Master: 38cba8fe6d7a41dd8b37f7047432eab9 (127.17.79.1:39701)
I20260811 02:36:22.706768 15286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:38897
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:36:22.729197 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38949
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:22.813211 15656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:22.813421 15656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:22.813444 15656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:22.814715 15656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:22.814759 15656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:22.814785 15656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:36:22.816155 15656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:22.816342 15656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:22.816515 15656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:22.821699 15670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.821745 15669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.821794 15677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:22.821943 15656 server_base.cc:1034] running on GCE node
I20260811 02:36:22.822141 15656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:22.822479 15656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:22.823683 15656 hybrid_clock.cc:648] HybridClock initialized: now 1786415782823676 us; error 43 us; skew 500 ppm
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:22.826563 15656 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:36:22.827093 15656 webserver.cc:460] Webserver started at http://127.17.79.2:45741/ using document root <none> and password file <none>
I20260811 02:36:22.827347 15656 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:22.827428 15656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:22.827600 15656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:22.828734 15656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "7d6fd3b9603248799f692b2684795d30"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "727059bc768ae3a3f64951d0c85c5935"
server_key_iv: "edd3395d630518b3e11b28e23a9d2bd7"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.829133 15656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "7d6fd3b9603248799f692b2684795d30"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "727059bc768ae3a3f64951d0c85c5935"
server_key_iv: "edd3395d630518b3e11b28e23a9d2bd7"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.830653 15656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260811 02:36:22.831533 15687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.831779 15656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:22.831920 15656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "7d6fd3b9603248799f692b2684795d30"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "727059bc768ae3a3f64951d0c85c5935"
server_key_iv: "edd3395d630518b3e11b28e23a9d2bd7"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.832005 15656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:22.841733 15656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:22.843832 15656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:22.843999 15656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:22.844235 15656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:22.844553 15656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:22.844609 15656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.844650 15656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:22.844676 15656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.850698 15656 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:44095
I20260811 02:36:22.850742 15881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:44095 every 8 connection(s)
I20260811 02:36:22.851065 15656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:36:22.855283 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 15656
I20260811 02:36:22.855414 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:36:22.855639 17724 external_mini_cluster.cc:1428] Setting key 585a73965ca0c989dc637bfae276731f
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:22.860991 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:22.851820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:54557 (local address 127.17.79.62:38949)
0811 02:36:22.851887 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:22.851889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:22.852072 (+ 183us) server_negotiation.cc:407] Connection header received
0811 02:36:22.852546 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:22.852547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:22.852556 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:22.852616 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:22.853539 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.854055 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.855241 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.855503 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.855585 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:22.858123 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:22.858124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:22.858125 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:22.858133 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:22.859566 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:22.859998 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:22.859999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:22.860000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:22.860066 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:22.860326 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:22.860327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:22.860328 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:22.860450 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:22.860531 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:22.860810 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 02:36:22.860896 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:36:22.861188 15885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:22.851781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38949 (local address 127.17.79.2:54557)
0811 02:36:22.851944 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:22.851985 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:22.852454 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:22.852664 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:22.852667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:22.853244 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:22.853432 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:22.853436 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.854217 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.854218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:22.855133 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:22.855136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:22.855609 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:22.855610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:22.855765 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:22.856355 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:22.856367 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:22.858007 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:22.859669 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:22.859677 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:22.859679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:22.859906 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:22.860136 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:22.860137 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:22.860137 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:22.860254 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:22.860519 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:22.860526 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:22.860678 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 02:36:22.860789 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 02:36:22.860955 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260811 02:36:22.861726 15883 heartbeater.cc:347] Connected to a master server at 127.17.79.62:38949
I20260811 02:36:22.861864 15883 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:22.862084 15883 heartbeater.cc:511] Master 127.17.79.62:38949 requested a full tablet report, sending...
I20260811 02:36:22.862845 15286 ts_manager.cc:194] Registered new tserver with Master: 7d6fd3b9603248799f692b2684795d30 (127.17.79.2:44095)
I20260811 02:36:22.863333 15286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:54557
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:36:22.886010 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38949
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:22.970283 15893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:22.970484 15893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:22.970507 15893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:22.971661 15893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:22.971709 15893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:22.971736 15893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:36:22.973340 15893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:38949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:22.973614 15893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:22.973824 15893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:36:22.979365 15893 server_base.cc:1034] running on GCE node
W20260811 02:36:22.979348 15903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.979333 15906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:22.979348 15904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:22.979768 15893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:22.980019 15893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:22.981189 15893 hybrid_clock.cc:648] HybridClock initialized: now 1786415782981179 us; error 40 us; skew 500 ppm
Aug 11 02:36:22 dist-test-slave-7nm7 krb5kdc[15216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:22.983708 15893 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:36:22.984087 15893 webserver.cc:460] Webserver started at http://127.17.79.3:43597/ using document root <none> and password file <none>
I20260811 02:36:22.984279 15893 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:22.984320 15893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:22.984409 15893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:22.985380 15893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "1d20ea3a74cf450b8a8b525935d1113c"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "05384c3a7958069bd852bb927c54a96f"
server_key_iv: "da1d6023a8060011f1c735d66675afdc"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.985675 15893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "1d20ea3a74cf450b8a8b525935d1113c"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "05384c3a7958069bd852bb927c54a96f"
server_key_iv: "da1d6023a8060011f1c735d66675afdc"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.987035 15893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:36:22.987773 15915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:22.987949 15893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:22.988034 15893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "1d20ea3a74cf450b8a8b525935d1113c"
format_stamp: "Formatted at 2026-08-11 02:36:22 on dist-test-slave-7nm7"
server_key: "05384c3a7958069bd852bb927c54a96f"
server_key_iv: "da1d6023a8060011f1c735d66675afdc"
server_key_version: "encryptionkey@0"
I20260811 02:36:22.988099 15893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:23.000350 15893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:23.002655 15893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:23.002774 15893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:23.002950 15893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:23.003268 15893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:23.003304 15893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:23.003326 15893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:23.003340 15893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:23.009142 15893 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:43927
I20260811 02:36:23.009232 16117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:43927 every 8 connection(s)
I20260811 02:36:23.009547 15893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:36:23.011977 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 15893
I20260811 02:36:23.012079 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:36:23.012264 17724 external_mini_cluster.cc:1428] Setting key 2f12661053722cb1f27891b8567e8345
Aug 11 02:36:23 dist-test-slave-7nm7 krb5kdc[15216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415782, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:23.019397 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.010331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:34121 (local address 127.17.79.62:38949)
0811 02:36:23.010395 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.010397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.010658 (+ 261us) server_negotiation.cc:407] Connection header received
0811 02:36:23.011200 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.011201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.011213 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.011272 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:23.012263 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.012809 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.013795 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.014004 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.014083 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.016299 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:23.016301 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:23.016301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:23.016307 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:23.017838 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:23.018477 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:23.018478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:23.018478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:23.018538 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:23.018832 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:23.018833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:23.018833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:23.018939 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:23.018990 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.019247 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.019331 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 02:36:23.019527 16120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.010304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:38949 (local address 127.17.79.3:34121)
0811 02:36:23.010533 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.010570 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:23.011083 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:23.011341 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:23.011352 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:23.011911 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:23.012136 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.012151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.012914 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.012916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.013698 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.013700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.014093 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.014094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.014290 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.014833 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:23.014841 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:23.016211 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:23.017967 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:23.017976 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:23.017978 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:23.018374 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:23.018614 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:23.018615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:23.018615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:23.018757 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:23.018998 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:23.019003 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:23.019118 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 02:36:23.019202 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 02:36:23.019324 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":108,"threads_started":1}
I20260811 02:36:23.020023 16118 heartbeater.cc:347] Connected to a master server at 127.17.79.62:38949
I20260811 02:36:23.020109 16118 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:23.020315 16118 heartbeater.cc:511] Master 127.17.79.62:38949 requested a full tablet report, sending...
I20260811 02:36:23.020700 15286 ts_manager.cc:194] Registered new tserver with Master: 1d20ea3a74cf450b8a8b525935d1113c (127.17.79.3:43927)
I20260811 02:36:23.021085 15286 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:34121
I20260811 02:36:23.023892 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:36:23.031044 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.025242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38176 (local address 127.17.79.62:38949)
0811 02:36:23.025317 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.025318 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.025412 (+ 94us) server_negotiation.cc:407] Connection header received
0811 02:36:23.025481 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.025482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.025492 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.025547 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:23.026092 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.026633 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.027361 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.027556 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.027626 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.028706 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:23.028707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:23.028708 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:23.028714 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:23.029833 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:23.030187 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:23.030189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:23.030189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:23.030289 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:23.030497 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:23.030498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:23.030498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:23.030650 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:23.030762 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.030861 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.030944 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 02:36:23.032413 15286 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:36:23.034109 15286 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:36:23.040498 16137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.036535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:43927 (local address 127.0.0.1:42344)
0811 02:36:23.037130 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.037160 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:23.037268 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:23.037492 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:23.037495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:23.037497 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:23.037564 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.037567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.038511 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.038512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.039508 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.039511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.040174 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.040175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.040264 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.040286 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 02:36:23.040365 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 02:36:23.040422 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":64,"threads_started":1}
I20260811 02:36:23.040509 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.036819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42344 (local address 127.17.79.3:43927)
0811 02:36:23.036971 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.036974 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.037240 (+ 266us) server_negotiation.cc:407] Connection header received
0811 02:36:23.037362 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.037365 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.037384 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.037467 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:23.037656 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.038413 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.039594 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.040083 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.040175 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.040235 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.040394 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.040433 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260811 02:36:23.041368 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.036533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:44095 (local address 127.0.0.1:33482)
0811 02:36:23.037116 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.037160 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:23.037239 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:23.037560 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:23.037561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:23.037563 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:23.037616 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.037618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.038950 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.038952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.040144 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.040145 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.041118 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.041119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.041183 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.041187 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:23.041246 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 02:36:23.041283 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":3,"thread_start_us":95,"threads_started":1}
I20260811 02:36:23.041414 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.036812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33482 (local address 127.17.79.2:44095)
0811 02:36:23.037050 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.037052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.037331 (+ 279us) server_negotiation.cc:407] Connection header received
0811 02:36:23.037381 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.037383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.037399 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.037474 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:23.037693 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.038838 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.040240 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.040956 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.041025 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.041076 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.041261 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.041324 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":97,"threads_started":1}
I20260811 02:36:23.041640 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.036703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44988 (local address 127.17.79.1:39701)
0811 02:36:23.036876 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.036888 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.037413 (+ 525us) server_negotiation.cc:407] Connection header received
0811 02:36:23.037550 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.037553 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.037567 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.037621 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:23.037846 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.038939 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.040261 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.040956 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.041006 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.041078 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.041525 (+ 447us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.041572 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
I20260811 02:36:23.041843 16135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.036533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39701 (local address 127.0.0.1:44988)
0811 02:36:23.037356 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.037365 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:23.037443 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:23.037730 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:23.037731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:23.037733 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:23.037766 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.037767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.039044 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.039044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.040143 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.040145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.041349 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.041350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.041415 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.041420 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:36:23.041730 (+ 310us) client_negotiation.cc:240] Negotiation successful
0811 02:36:23.041781 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"mutex_wait_us":466,"thread_start_us":113,"threads_started":1}
I20260811 02:36:23.041819 16008 tablet_service.cc:1467] Processing CreateTablet for tablet b3312152fea149f88a979f16f346a0e0 (DEFAULT_TABLE table=test-table [id=9f81cfa1f5db49f1842b0bd395b99f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:23.041987 15780 tablet_service.cc:1467] Processing CreateTablet for tablet b3312152fea149f88a979f16f346a0e0 (DEFAULT_TABLE table=test-table [id=9f81cfa1f5db49f1842b0bd395b99f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:23.042199 16008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3312152fea149f88a979f16f346a0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:23.042332 15780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3312152fea149f88a979f16f346a0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:23.042493 15522 tablet_service.cc:1467] Processing CreateTablet for tablet b3312152fea149f88a979f16f346a0e0 (DEFAULT_TABLE table=test-table [id=9f81cfa1f5db49f1842b0bd395b99f4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:23.042752 15522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3312152fea149f88a979f16f346a0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:23.045414 16148 tablet_bootstrap.cc:492] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9: Bootstrap starting.
I20260811 02:36:23.045742 16150 tablet_bootstrap.cc:492] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Bootstrap starting.
I20260811 02:36:23.046404 16148 tablet_bootstrap.cc:654] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:23.046404 16150 tablet_bootstrap.cc:654] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:23.047034 16148 log.cc:824] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:23.047027 16150 log.cc:824] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:23.047394 16151 tablet_bootstrap.cc:492] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Bootstrap starting.
I20260811 02:36:23.047827 16148 tablet_bootstrap.cc:492] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9: No bootstrap required, opened a new log
I20260811 02:36:23.047901 16148 ts_tablet_manager.cc:1397] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 02:36:23.048092 16151 tablet_bootstrap.cc:654] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:23.048667 16151 log.cc:824] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:23.049401 16151 tablet_bootstrap.cc:492] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: No bootstrap required, opened a new log
I20260811 02:36:23.049460 16150 tablet_bootstrap.cc:492] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: No bootstrap required, opened a new log
I20260811 02:36:23.049500 16151 ts_tablet_manager.cc:1397] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:36:23.049536 16150 ts_tablet_manager.cc:1397] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 02:36:23.050153 16148 raft_consensus.cc:348] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.050377 16148 raft_consensus.cc:374] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:23.050420 16148 raft_consensus.cc:729] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38cba8fe6d7a41dd8b37f7047432eab9, State: Initialized, Role: FOLLOWER
I20260811 02:36:23.050559 16148 consensus_queue.cc:260] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.050856 16148 ts_tablet_manager.cc:1428] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260811 02:36:23.050879 15645 heartbeater.cc:503] Master 127.17.79.62:38949 was elected leader, sending a full tablet report...
I20260811 02:36:23.051383 16151 raft_consensus.cc:348] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.051549 16151 raft_consensus.cc:374] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:23.051587 16151 raft_consensus.cc:729] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d6fd3b9603248799f692b2684795d30, State: Initialized, Role: FOLLOWER
I20260811 02:36:23.051564 16150 raft_consensus.cc:348] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.051739 16150 raft_consensus.cc:374] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:23.051724 16151 consensus_queue.cc:260] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.051788 16150 raft_consensus.cc:729] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d20ea3a74cf450b8a8b525935d1113c, State: Initialized, Role: FOLLOWER
I20260811 02:36:23.051923 16150 consensus_queue.cc:260] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.052189 16150 ts_tablet_manager.cc:1428] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:36:23.052222 15883 heartbeater.cc:503] Master 127.17.79.62:38949 was elected leader, sending a full tablet report...
I20260811 02:36:23.052313 16118 heartbeater.cc:503] Master 127.17.79.62:38949 was elected leader, sending a full tablet report...
I20260811 02:36:23.052393 16151 ts_tablet_manager.cc:1428] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260811 02:36:23.101729 15884 tablet.cc:2369] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:36:23.195355 15649 tablet.cc:2369] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:36:23.260255 16119 tablet.cc:2369] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:23.454140 16159 raft_consensus.cc:482] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:23.454346 16159 raft_consensus.cc:504] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.454757 16159 leader_election.cc:288] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38cba8fe6d7a41dd8b37f7047432eab9 (127.17.79.1:39701), 1d20ea3a74cf450b8a8b525935d1113c (127.17.79.3:43927)
I20260811 02:36:23.457743 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.455055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:51995 (local address 127.17.79.3:43927)
0811 02:36:23.455103 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.455106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.455202 (+ 96us) server_negotiation.cc:407] Connection header received
0811 02:36:23.455280 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.455281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.455295 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.455370 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:23.455535 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.456015 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.456996 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.457369 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.457454 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.457466 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.457626 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.457659 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:36:23.457744 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.455017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:55475 (local address 127.17.79.1:39701)
0811 02:36:23.455075 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.455077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.455274 (+ 197us) server_negotiation.cc:407] Connection header received
0811 02:36:23.455352 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.455353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.455366 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.455410 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:23.455576 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.456047 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.457014 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.457389 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.457469 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.457481 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.457637 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.457673 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:36:23.457787 16164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.454951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:43927 (local address 127.17.79.2:51995)
0811 02:36:23.455103 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.455115 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:23.455219 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:23.455375 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:23.455376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:23.455379 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:23.455464 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.455466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.456107 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.456108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.456899 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.456901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.457458 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.457459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.457531 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.457541 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 02:36:23.457618 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 02:36:23.457658 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":86,"threads_started":1}
I20260811 02:36:23.457793 16163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.454960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39701 (local address 127.17.79.2:55475)
0811 02:36:23.455193 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.455202 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:23.455282 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:23.455422 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:23.455423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:23.455424 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:23.455504 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.455505 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.456134 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.456135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.456912 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.456914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.457485 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.457486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.457561 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.457565 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:23.457631 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 02:36:23.457671 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":11,"thread_start_us":66,"threads_started":1}
I20260811 02:36:23.458171 16039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3312152fea149f88a979f16f346a0e0" candidate_uuid: "7d6fd3b9603248799f692b2684795d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d20ea3a74cf450b8a8b525935d1113c" is_pre_election: true
I20260811 02:36:23.458367 16039 raft_consensus.cc:2454] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d6fd3b9603248799f692b2684795d30 in term 0.
I20260811 02:36:23.458390 15567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3312152fea149f88a979f16f346a0e0" candidate_uuid: "7d6fd3b9603248799f692b2684795d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" is_pre_election: true
I20260811 02:36:23.458554 15567 raft_consensus.cc:2454] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d6fd3b9603248799f692b2684795d30 in term 0.
I20260811 02:36:23.458643 15696 leader_election.cc:302] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d20ea3a74cf450b8a8b525935d1113c, 7d6fd3b9603248799f692b2684795d30; no voters:
I20260811 02:36:23.458771 16159 raft_consensus.cc:2781] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:36:23.458830 16159 raft_consensus.cc:482] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:36:23.458868 16159 raft_consensus.cc:3037] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:23.459599 16159 raft_consensus.cc:504] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.459786 16159 leader_election.cc:288] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [CANDIDATE]: Term 1 election: Requested vote from peers 38cba8fe6d7a41dd8b37f7047432eab9 (127.17.79.1:39701), 1d20ea3a74cf450b8a8b525935d1113c (127.17.79.3:43927)
I20260811 02:36:23.459949 16039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3312152fea149f88a979f16f346a0e0" candidate_uuid: "7d6fd3b9603248799f692b2684795d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d20ea3a74cf450b8a8b525935d1113c"
I20260811 02:36:23.459950 15567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3312152fea149f88a979f16f346a0e0" candidate_uuid: "7d6fd3b9603248799f692b2684795d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38cba8fe6d7a41dd8b37f7047432eab9"
I20260811 02:36:23.460017 16039 raft_consensus.cc:3037] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:23.460040 15567 raft_consensus.cc:3037] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:23.460728 16039 raft_consensus.cc:2454] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d6fd3b9603248799f692b2684795d30 in term 1.
I20260811 02:36:23.460788 15567 raft_consensus.cc:2454] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d6fd3b9603248799f692b2684795d30 in term 1.
I20260811 02:36:23.460889 15696 leader_election.cc:302] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d20ea3a74cf450b8a8b525935d1113c, 7d6fd3b9603248799f692b2684795d30; no voters:
I20260811 02:36:23.460984 16159 raft_consensus.cc:2781] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:23.461144 16159 raft_consensus.cc:686] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 1 LEADER]: Becoming Leader. State: Replica: 7d6fd3b9603248799f692b2684795d30, State: Running, Role: LEADER
I20260811 02:36:23.461371 16159 consensus_queue.cc:237] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } }
I20260811 02:36:23.462291 15285 catalog_manager.cc:5495] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d6fd3b9603248799f692b2684795d30 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "7d6fd3b9603248799f692b2684795d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d6fd3b9603248799f692b2684795d30" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 } health_report { overall_health: UNKNOWN } } }
I20260811 02:36:23.486625 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.484108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33488 (local address 127.17.79.2:44095)
0811 02:36:23.484182 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.484184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.484209 (+ 25us) server_negotiation.cc:407] Connection header received
0811 02:36:23.484245 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.484246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.484272 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.484332 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:36:23.484495 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.484988 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.485786 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.485974 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.486043 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.486215 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:36:23.486381 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:36:23.486459 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.486507 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.486525 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 02:36:23.488765 16039 raft_consensus.cc:1261] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 1 FOLLOWER]: Refusing update from remote peer 7d6fd3b9603248799f692b2684795d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:23.488775 15567 raft_consensus.cc:1261] T b3312152fea149f88a979f16f346a0e0 P 38cba8fe6d7a41dd8b37f7047432eab9 [term 1 FOLLOWER]: Refusing update from remote peer 7d6fd3b9603248799f692b2684795d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:23.489153 16165 consensus_queue.cc:1035] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38cba8fe6d7a41dd8b37f7047432eab9" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:23.489298 16159 consensus_queue.cc:1035] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d20ea3a74cf450b8a8b525935d1113c" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 43927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:23.492025 16174 mvcc.cc:205] Tried to move back new op lower bound from 7317159049166319616 to 7317159049058471936. Current Snapshot: MvccSnapshot[applied={T|T < 7317159049166319616}]
I20260811 02:36:23.492359 16171 mvcc.cc:205] Tried to move back new op lower bound from 7317159049166319616 to 7317159049058471936. Current Snapshot: MvccSnapshot[applied={T|T < 7317159049166319616}]
I20260811 02:36:23.492664 16168 mvcc.cc:205] Tried to move back new op lower bound from 7317159049166319616 to 7317159049058471936. Current Snapshot: MvccSnapshot[applied={T|T < 7317159049166319616 or (T in {7317159049166319616})}]
I20260811 02:36:23.494087 15286 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:23.494197 15286 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:23.495012 15286 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a105d21d7b3a4683850d407177e855ea: Sending DeleteTablet for 3 replicas of tablet b3312152fea149f88a979f16f346a0e0
I20260811 02:36:23.495325 15780 tablet_service.cc:1514] Processing DeleteTablet for tablet b3312152fea149f88a979f16f346a0e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:23 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:33482
I20260811 02:36:23.495419 15522 tablet_service.cc:1514] Processing DeleteTablet for tablet b3312152fea149f88a979f16f346a0e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:23 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:44988
I20260811 02:36:23.495534 16008 tablet_service.cc:1514] Processing DeleteTablet for tablet b3312152fea149f88a979f16f346a0e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:23 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:42344
I20260811 02:36:23.495679 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 15411
I20260811 02:36:23.495855 16191 tablet_replica.cc:330] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: stopping tablet replica
I20260811 02:36:23.495952 16191 raft_consensus.cc:2229] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:36:23.496037 16191 raft_consensus.cc:2258] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:23.498983 16191 ts_tablet_manager.cc:1905] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:23.500800 16191 ts_tablet_manager.cc:1918] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:23.500880 16191 log.cc:1196] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/b3312152fea149f88a979f16f346a0e0
I20260811 02:36:23.501145 16191 ts_tablet_manager.cc:1939] T b3312152fea149f88a979f16f346a0e0 P 7d6fd3b9603248799f692b2684795d30: Deleting consensus metadata
I20260811 02:36:23.501580 15266 catalog_manager.cc:4841] TS 7d6fd3b9603248799f692b2684795d30 (127.17.79.2:44095): tablet b3312152fea149f88a979f16f346a0e0 (table test-table [id=9f81cfa1f5db49f1842b0bd395b99f4c]) successfully deleted
I20260811 02:36:23.507069 16195 tablet_replica.cc:330] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: stopping tablet replica
I20260811 02:36:23.507233 16195 raft_consensus.cc:2229] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:23.507362 16195 raft_consensus.cc:2258] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:23.507882 16195 ts_tablet_manager.cc:1905] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:23.509611 16195 ts_tablet_manager.cc:1918] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:23.509694 16195 log.cc:1196] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/b3312152fea149f88a979f16f346a0e0
I20260811 02:36:23.509965 16195 ts_tablet_manager.cc:1939] T b3312152fea149f88a979f16f346a0e0 P 1d20ea3a74cf450b8a8b525935d1113c: Deleting consensus metadata
I20260811 02:36:23.510478 15267 catalog_manager.cc:4841] TS 1d20ea3a74cf450b8a8b525935d1113c (127.17.79.3:43927): tablet b3312152fea149f88a979f16f346a0e0 (table test-table [id=9f81cfa1f5db49f1842b0bd395b99f4c]) successfully deleted
W20260811 02:36:23.514218 15265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:39701 (error 108)
I20260811 02:36:23.514504 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 15656
I20260811 02:36:23.525111 16135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.524909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39701 (local address 127.0.0.1:44994)
0811 02:36:23.524988 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.525054 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:39701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 02:36:23.525312 15265 catalog_manager.cc:4584] TS 38cba8fe6d7a41dd8b37f7047432eab9 (127.17.79.1:39701): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b3312152fea149f88a979f16f346a0e0: Network error: Client connection negotiation failed: client connection to 127.17.79.1:39701: connect: Connection refused (error 111)
I20260811 02:36:23.533877 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 15893
I20260811 02:36:23.543772 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 15235
2026-08-11T02:36:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2654 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T02:36:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:23Z Disabled control of system clock
I20260811 02:36:23.577783 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35611
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:35611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:23.660907 16203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:23.661149 16203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:23.661172 16203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:23.662659 16203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:23.662717 16203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:23.662731 16203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:23.662744 16203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:23.662756 16203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:23.664259 16203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:35611
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:23.664528 16203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:23.664844 16203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:23.669940 16214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:23.669963 16209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:23.669970 16203 server_base.cc:1034] running on GCE node
W20260811 02:36:23.669934 16210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:23.670451 16203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:23.670763 16203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:23.671926 16203 hybrid_clock.cc:648] HybridClock initialized: now 1786415783671918 us; error 36 us; skew 500 ppm
I20260811 02:36:23.673221 16203 webserver.cc:460] Webserver started at http://127.17.79.62:32795/ using document root <none> and password file <none>
I20260811 02:36:23.673465 16203 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:23.673537 16203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:23.673698 16203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:23.674819 16203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "0ecb621027574969999e25ac865b1626"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "ab3c8cbe5458b7901e9370becd07cfbc"
server_key_iv: "dc33088f00ca83b20163e5ed03dfa32e"
server_key_version: "encryptionkey@0"
I20260811 02:36:23.675190 16203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "0ecb621027574969999e25ac865b1626"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "ab3c8cbe5458b7901e9370becd07cfbc"
server_key_iv: "dc33088f00ca83b20163e5ed03dfa32e"
server_key_version: "encryptionkey@0"
I20260811 02:36:23.676565 16203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:23.677299 16223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:23.677479 16203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:36:23.677588 16203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "0ecb621027574969999e25ac865b1626"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "ab3c8cbe5458b7901e9370becd07cfbc"
server_key_iv: "dc33088f00ca83b20163e5ed03dfa32e"
server_key_version: "encryptionkey@0"
I20260811 02:36:23.677663 16203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:23.689705 16203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:23.690032 16203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:23.690191 16203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:23.694464 16203 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:35611
I20260811 02:36:23.694501 16320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:35611 every 8 connection(s)
I20260811 02:36:23.694840 16203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:23.696359 16321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:23.698837 16321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626: Bootstrap starting.
I20260811 02:36:23.699445 16321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:23.699754 16321 log.cc:824] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:23.700457 16321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626: No bootstrap required, opened a new log
I20260811 02:36:23.702077 16321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ecb621027574969999e25ac865b1626" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35611 } }
I20260811 02:36:23.702224 16321 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:23.702304 16321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecb621027574969999e25ac865b1626, State: Initialized, Role: FOLLOWER
I20260811 02:36:23.702468 16321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ecb621027574969999e25ac865b1626" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35611 } }
I20260811 02:36:23.702546 16321 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:23.702569 16321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:23.702621 16321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:23.702786 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 16203
I20260811 02:36:23.702894 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:23.703076 17724 external_mini_cluster.cc:1428] Setting key 8116a6947e729dba34b95a94e72de596
I20260811 02:36:23.703364 16321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ecb621027574969999e25ac865b1626" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35611 } }
I20260811 02:36:23.703500 16321 leader_election.cc:302] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ecb621027574969999e25ac865b1626; no voters:
I20260811 02:36:23.703685 16321 leader_election.cc:288] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:23.703809 16325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:23.703954 16321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:23.703980 16325 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecb621027574969999e25ac865b1626, State: Running, Role: LEADER
I20260811 02:36:23.704067 16325 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ecb621027574969999e25ac865b1626" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35611 } }
I20260811 02:36:23.704392 16325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ecb621027574969999e25ac865b1626. Latest consensus state: current_term: 1 leader_uuid: "0ecb621027574969999e25ac865b1626" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ecb621027574969999e25ac865b1626" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35611 } } }
I20260811 02:36:23.704483 16325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:23.704618 16331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ecb621027574969999e25ac865b1626" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ecb621027574969999e25ac865b1626" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35611 } } }
I20260811 02:36:23.704774 16331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626 [sys.catalog]: This master's current role is: LEADER
W20260811 02:36:23.705807 16353 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:36:23.705905 16353 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:36:23.706007 16343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:23.706182 16343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:23.707969 16343 catalog_manager.cc:1347] Generated new cluster ID: 3064cf7f05bf4067b3c3494e32b87b5a
I20260811 02:36:23.708024 16343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:23.709482 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.703676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59330 (local address 127.17.79.62:35611)
0811 02:36:23.704069 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.704078 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.704114 (+ 36us) server_negotiation.cc:407] Connection header received
0811 02:36:23.704241 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.704248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.704324 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.704734 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:23.704868 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.706338 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.707296 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.707880 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.708017 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.708739 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:23.708742 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:23.708743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:23.708959 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:23.709000 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:23.709015 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:23.709089 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.709173 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.709264 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":106,"threads_started":1}
I20260811 02:36:23.737537 16343 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:23.738224 16343 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:23.742197 16343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626: Generated new TSK 0
I20260811 02:36:23.742425 16343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:23.749658 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35611
--builtin_ntp_servers=127.17.79.20:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:23.834759 16358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:23.835053 16358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:23.835094 16358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:23.836310 16358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:23.836377 16358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:23.836422 16358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:36:23.837795 16358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:23.838071 16358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:23.838450 16358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:23.843590 16367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:23.843614 16373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:23.843590 16376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:23.851176 16358 server_base.cc:1034] running on GCE node
I20260811 02:36:23.851495 16358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:23.851833 16358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:23.852999 16358 hybrid_clock.cc:648] HybridClock initialized: now 1786415783852981 us; error 33 us; skew 500 ppm
I20260811 02:36:23.854771 16358 webserver.cc:460] Webserver started at http://127.17.79.1:43899/ using document root <none> and password file <none>
I20260811 02:36:23.855077 16358 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:23.855154 16358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:23.855414 16358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:23.857009 16358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "58e83bb2760a519d565dace2810d2daf"
server_key_iv: "a1426dfc040355a006d699b7d6a9de9e"
server_key_version: "encryptionkey@0"
I20260811 02:36:23.857484 16358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "58e83bb2760a519d565dace2810d2daf"
server_key_iv: "a1426dfc040355a006d699b7d6a9de9e"
server_key_version: "encryptionkey@0"
I20260811 02:36:23.859340 16358 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260811 02:36:23.860276 16385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:23.860507 16358 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:23.860615 16358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "58e83bb2760a519d565dace2810d2daf"
server_key_iv: "a1426dfc040355a006d699b7d6a9de9e"
server_key_version: "encryptionkey@0"
I20260811 02:36:23.860713 16358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:23.872607 16358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:23.872961 16358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:23.873119 16358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:23.873405 16358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:23.873775 16358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:23.873831 16358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:23.873870 16358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:23.873894 16358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:23.880338 16358 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:41805
I20260811 02:36:23.880491 16588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:41805 every 8 connection(s)
I20260811 02:36:23.880815 16358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:36:23.886726 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.881665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:48917 (local address 127.17.79.62:35611)
0811 02:36:23.881721 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:23.881723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:23.882065 (+ 342us) server_negotiation.cc:407] Connection header received
0811 02:36:23.882764 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:23.882765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:23.882777 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:23.882862 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:23.883571 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.884099 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.885175 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.885380 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.885458 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.886413 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:23.886415 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:23.886416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:23.886423 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:23.886439 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:23.886443 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:23.886521 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:23.886605 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 02:36:23.886641 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:36:23.886958 16591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:23.881703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35611 (local address 127.17.79.1:48917)
0811 02:36:23.881896 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:23.881946 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:23.882657 (+ 711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:23.882946 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:23.882951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:23.882966 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:23.883473 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.883478 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.884219 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.884220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.885066 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:23.885068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:23.885467 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:23.885469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:23.885611 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:23.886202 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:23.886202 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:23.886277 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:23.886310 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:23.886524 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:23.886531 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:23.886535 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:23.886605 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 02:36:23.886720 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":84,"threads_started":1}
I20260811 02:36:23.887557 16589 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35611
I20260811 02:36:23.887674 16589 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:23.887867 16589 heartbeater.cc:511] Master 127.17.79.62:35611 requested a full tablet report, sending...
I20260811 02:36:23.888425 16257 ts_manager.cc:194] Registered new tserver with Master: b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 (127.17.79.1:41805)
I20260811 02:36:23.889058 16257 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.1:48917
I20260811 02:36:23.890937 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 16358
I20260811 02:36:23.891040 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:36:23.891249 17724 external_mini_cluster.cc:1428] Setting key 72c211985c207bb77c7786c8ab270785
I20260811 02:36:23.892132 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35611
--builtin_ntp_servers=127.17.79.20:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:23.988785 16593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:23.988989 16593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:23.989010 16593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:23.990065 16593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:23.990097 16593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:23.990121 16593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:36:23.991480 16593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:23.991667 16593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:23.991910 16593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:23.997148 16602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:23.997140 16603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:23.997185 16593 server_base.cc:1034] running on GCE node
W20260811 02:36:23.997139 16605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:23.997509 16593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:23.997727 16593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:23.998901 16593 hybrid_clock.cc:648] HybridClock initialized: now 1786415783998885 us; error 26 us; skew 500 ppm
I20260811 02:36:24.000249 16593 webserver.cc:460] Webserver started at http://127.17.79.2:46219/ using document root <none> and password file <none>
I20260811 02:36:24.000505 16593 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:24.000586 16593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:24.000751 16593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:24.001830 16593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "363b2339b060408792645cfa7d900813"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "6a50d3e416efa513bdf89f4cd0867949"
server_key_iv: "e823ad4905821d6f8c87a739f9553f30"
server_key_version: "encryptionkey@0"
I20260811 02:36:24.002205 16593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "363b2339b060408792645cfa7d900813"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "6a50d3e416efa513bdf89f4cd0867949"
server_key_iv: "e823ad4905821d6f8c87a739f9553f30"
server_key_version: "encryptionkey@0"
I20260811 02:36:24.003778 16593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:24.004602 16612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:24.004825 16593 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:24.004922 16593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "363b2339b060408792645cfa7d900813"
format_stamp: "Formatted at 2026-08-11 02:36:23 on dist-test-slave-7nm7"
server_key: "6a50d3e416efa513bdf89f4cd0867949"
server_key_iv: "e823ad4905821d6f8c87a739f9553f30"
server_key_version: "encryptionkey@0"
I20260811 02:36:24.004998 16593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:24.019945 16593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:24.020263 16593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:24.020411 16593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:24.020637 16593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:24.020984 16593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:24.021039 16593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:24.021081 16593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:24.021108 16593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:24.026815 16593 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:34885
I20260811 02:36:24.026896 16813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:34885 every 8 connection(s)
I20260811 02:36:24.027237 16593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:36:24.028831 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 16593
I20260811 02:36:24.028942 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:36:24.029122 17724 external_mini_cluster.cc:1428] Setting key 407af9ce3cc58f3997d2b566faac5363
I20260811 02:36:24.030054 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35611
--builtin_ntp_servers=127.17.79.20:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 02:36:24.032939 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.028059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:47157 (local address 127.17.79.62:35611)
0811 02:36:24.028181 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.028183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.028418 (+ 235us) server_negotiation.cc:407] Connection header received
0811 02:36:24.028970 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.028971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.028984 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.029048 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:24.029818 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.030384 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.031406 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.031673 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.031762 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.032648 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:24.032650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:24.032650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:24.032656 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:24.032674 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:24.032687 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:24.032757 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.032825 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.032855 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 02:36:24.033135 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.028033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35611 (local address 127.17.79.2:47157)
0811 02:36:24.028289 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.028326 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:24.028855 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:24.029117 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:24.029122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:24.029131 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:24.029719 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.029724 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.030485 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.030486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.031308 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.031310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.031790 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.031791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.031923 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.032504 (+ 581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:24.032505 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:24.032533 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:24.032554 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:24.032763 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:24.032768 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:24.032770 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:36:24.032824 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 02:36:24.032905 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":102,"threads_started":1}
I20260811 02:36:24.033593 16817 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35611
I20260811 02:36:24.033715 16817 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:24.033892 16817 heartbeater.cc:511] Master 127.17.79.62:35611 requested a full tablet report, sending...
I20260811 02:36:24.034400 16257 ts_manager.cc:194] Registered new tserver with Master: 363b2339b060408792645cfa7d900813 (127.17.79.2:34885)
I20260811 02:36:24.034794 16257 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.2:47157
W20260811 02:36:24.122524 16820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:24.122748 16820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:24.122776 16820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:24.124046 16820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:24.124094 16820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:24.124122 16820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:36:24.125579 16820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:35611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:24.125864 16820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:24.126210 16820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:24.131443 16833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:24.131456 16827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:24.131467 16825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:24.131652 16820 server_base.cc:1034] running on GCE node
I20260811 02:36:24.131888 16820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:24.132097 16820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:24.133253 16820 hybrid_clock.cc:648] HybridClock initialized: now 1786415784133244 us; error 33 us; skew 500 ppm
I20260811 02:36:24.134717 16820 webserver.cc:460] Webserver started at http://127.17.79.3:46279/ using document root <none> and password file <none>
I20260811 02:36:24.134987 16820 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:24.135066 16820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:24.135226 16820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:24.136337 16820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "e8046b5ad9f14056a20379f68fe49eac"
format_stamp: "Formatted at 2026-08-11 02:36:24 on dist-test-slave-7nm7"
server_key: "03472289eb121cfc258b4b55c5b347ec"
server_key_iv: "d2b53234676407dece97e1a3f34c52db"
server_key_version: "encryptionkey@0"
I20260811 02:36:24.136724 16820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "e8046b5ad9f14056a20379f68fe49eac"
format_stamp: "Formatted at 2026-08-11 02:36:24 on dist-test-slave-7nm7"
server_key: "03472289eb121cfc258b4b55c5b347ec"
server_key_iv: "d2b53234676407dece97e1a3f34c52db"
server_key_version: "encryptionkey@0"
I20260811 02:36:24.138170 16820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:24.138998 16844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:24.139251 16820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:24.139386 16820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "e8046b5ad9f14056a20379f68fe49eac"
format_stamp: "Formatted at 2026-08-11 02:36:24 on dist-test-slave-7nm7"
server_key: "03472289eb121cfc258b4b55c5b347ec"
server_key_iv: "d2b53234676407dece97e1a3f34c52db"
server_key_version: "encryptionkey@0"
I20260811 02:36:24.139468 16820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:24.155174 16820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:24.155548 16820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:24.155711 16820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:24.155967 16820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:24.156327 16820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:24.156383 16820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:24.156427 16820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:24.156459 16820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:24.162868 16820 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:35195
I20260811 02:36:24.162911 17048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:35195 every 8 connection(s)
I20260811 02:36:24.163352 16820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:36:24.167541 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 16820
I20260811 02:36:24.167625 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:36:24.167851 17724 external_mini_cluster.cc:1428] Setting key 296d08a3c13836d60fa1617fef996dc6
I20260811 02:36:24.169037 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.164175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:46933 (local address 127.17.79.62:35611)
0811 02:36:24.164253 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.164256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.164507 (+ 251us) server_negotiation.cc:407] Connection header received
0811 02:36:24.165071 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.165072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.165085 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.165145 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:24.165843 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.166449 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.167434 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.167682 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.167773 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.168768 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:24.168769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:24.168770 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:24.168775 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:24.168790 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:24.168795 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:24.168850 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.168930 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.168960 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:36:24.169258 17052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.164163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:35611 (local address 127.17.79.3:46933)
0811 02:36:24.164387 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.164421 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:24.164962 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:24.165213 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:24.165218 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:24.165227 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:24.165744 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.165749 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.166549 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.166550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.167336 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.167338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.167785 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.167786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.167922 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.168598 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:24.168598 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:24.168627 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:24.168649 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:24.168852 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:24.168858 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:24.168861 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:36:24.168933 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 02:36:24.169035 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":119,"threads_started":1}
I20260811 02:36:24.169806 17049 heartbeater.cc:347] Connected to a master server at 127.17.79.62:35611
I20260811 02:36:24.169931 17049 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:24.170089 17049 heartbeater.cc:511] Master 127.17.79.62:35611 requested a full tablet report, sending...
I20260811 02:36:24.170467 16257 ts_manager.cc:194] Registered new tserver with Master: e8046b5ad9f14056a20379f68fe49eac (127.17.79.3:35195)
I20260811 02:36:24.170814 16257 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.3:46933
I20260811 02:36:24.179634 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:36:24.183869 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.181043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.17.79.62:35611)
0811 02:36:24.181114 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.181116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.181264 (+ 148us) server_negotiation.cc:407] Connection header received
0811 02:36:24.181311 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.181312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.181324 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.181364 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:24.181507 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.181970 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.182721 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.182897 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.182952 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.183610 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:24.183611 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:24.183611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:24.183615 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:24.183628 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:24.183632 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:24.183690 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.183728 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.183751 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 02:36:24.185765 16257 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:36:24.187460 16257 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:36:24.194536 17066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.190344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57284 (local address 127.17.79.2:34885)
0811 02:36:24.190621 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.190625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.190635 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:36:24.190673 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.190675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.190689 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.190775 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:24.190924 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.192047 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.193287 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.194043 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.194130 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.194258 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.194426 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.194463 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":101,"threads_started":1}
I20260811 02:36:24.194543 17058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.189835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:34885 (local address 127.0.0.1:57284)
0811 02:36:24.190106 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.190119 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:24.190182 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:24.190773 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:24.190774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:24.190777 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:24.190834 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.190836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.192140 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.192141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.193175 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.193177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.194148 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.194149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.194301 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.194326 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 02:36:24.194401 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 02:36:24.194460 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":2,"thread_start_us":62,"threads_started":1}
I20260811 02:36:24.195019 17059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.189840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:35195 (local address 127.0.0.1:34334)
0811 02:36:24.190361 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.190371 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:24.190431 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:24.190687 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:24.190688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:24.190690 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:24.190752 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.190754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.191782 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.191783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.193036 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.193038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.194778 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.194779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.194854 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.194859 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:36:24.194910 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 02:36:24.194952 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":111,"threads_started":1}
I20260811 02:36:24.195348 17065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.190138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.17.79.3:35195)
0811 02:36:24.190339 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.190344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.190506 (+ 162us) server_negotiation.cc:407] Connection header received
0811 02:36:24.190559 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.190561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.190578 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.190680 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:24.190843 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.191678 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.193193 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.194043 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.194130 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.194261 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.195194 (+ 933us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.195260 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":124,"threads_started":1}
I20260811 02:36:24.195464 17061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.189835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:41805 (local address 127.0.0.1:46876)
0811 02:36:24.190011 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.190053 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:24.190127 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:24.190560 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:24.190563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:24.190565 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:24.190643 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.190645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.193276 (+ 2631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.193277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.194189 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.194191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.195253 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.195253 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.195313 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.195316 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:36:24.195348 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 02:36:24.195389 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":67,"threads_started":1}
I20260811 02:36:24.195412 16703 tablet_service.cc:1467] Processing CreateTablet for tablet 6756c7c0fb874388b469e3e2a0e587c6 (DEFAULT_TABLE table=test-table [id=a45267e0f5df4a658e70e637b908544c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:24.195850 16703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6756c7c0fb874388b469e3e2a0e587c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:24.195907 17062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.190104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46876 (local address 127.17.79.1:41805)
0811 02:36:24.190301 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.190306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.190318 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:36:24.190433 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.190435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.190455 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.190546 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:24.190898 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.192049 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.194332 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.195155 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.195639 (+ 484us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.195754 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.195781 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.195823 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":106,"threads_started":1}
I20260811 02:36:24.195968 16931 tablet_service.cc:1467] Processing CreateTablet for tablet 6756c7c0fb874388b469e3e2a0e587c6 (DEFAULT_TABLE table=test-table [id=a45267e0f5df4a658e70e637b908544c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:24.196350 16931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6756c7c0fb874388b469e3e2a0e587c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:24.196504 16468 tablet_service.cc:1467] Processing CreateTablet for tablet 6756c7c0fb874388b469e3e2a0e587c6 (DEFAULT_TABLE table=test-table [id=a45267e0f5df4a658e70e637b908544c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:24.196843 16468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6756c7c0fb874388b469e3e2a0e587c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:24.199036 17068 tablet_bootstrap.cc:492] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Bootstrap starting.
I20260811 02:36:24.199767 17068 tablet_bootstrap.cc:654] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:24.199798 17069 tablet_bootstrap.cc:492] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Bootstrap starting.
I20260811 02:36:24.200189 17070 tablet_bootstrap.cc:492] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618: Bootstrap starting.
I20260811 02:36:24.200233 17068 log.cc:824] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:24.200440 17069 tablet_bootstrap.cc:654] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:24.200778 17069 log.cc:824] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:24.200845 17070 tablet_bootstrap.cc:654] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:24.201175 17068 tablet_bootstrap.cc:492] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: No bootstrap required, opened a new log
I20260811 02:36:24.201159 17070 log.cc:824] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:24.201252 17068 ts_tablet_manager.cc:1397] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:24.201767 17069 tablet_bootstrap.cc:492] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: No bootstrap required, opened a new log
I20260811 02:36:24.201841 17069 ts_tablet_manager.cc:1397] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:24.201922 17070 tablet_bootstrap.cc:492] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618: No bootstrap required, opened a new log
I20260811 02:36:24.201990 17070 ts_tablet_manager.cc:1397] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:24.203362 17068 raft_consensus.cc:348] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.203521 17068 raft_consensus.cc:374] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:24.203568 17068 raft_consensus.cc:729] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363b2339b060408792645cfa7d900813, State: Initialized, Role: FOLLOWER
I20260811 02:36:24.203706 17068 consensus_queue.cc:260] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.203991 17068 ts_tablet_manager.cc:1428] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:36:24.204337 16817 heartbeater.cc:503] Master 127.17.79.62:35611 was elected leader, sending a full tablet report...
I20260811 02:36:24.204598 17069 raft_consensus.cc:348] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.204777 17069 raft_consensus.cc:374] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:24.204947 17069 raft_consensus.cc:729] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8046b5ad9f14056a20379f68fe49eac, State: Initialized, Role: FOLLOWER
I20260811 02:36:24.204774 17070 raft_consensus.cc:348] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.205067 17070 raft_consensus.cc:374] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:24.205127 17070 raft_consensus.cc:729] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b77c1fd8fb4d4dbc8fd5a0cfbb6d5618, State: Initialized, Role: FOLLOWER
I20260811 02:36:24.205128 17069 consensus_queue.cc:260] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.205296 17070 consensus_queue.cc:260] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.205427 17069 ts_tablet_manager.cc:1428] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 02:36:24.205564 17049 heartbeater.cc:503] Master 127.17.79.62:35611 was elected leader, sending a full tablet report...
I20260811 02:36:24.205754 17070 ts_tablet_manager.cc:1428] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 02:36:24.205797 16589 heartbeater.cc:503] Master 127.17.79.62:35611 was elected leader, sending a full tablet report...
I20260811 02:36:24.230329 17078 raft_consensus.cc:482] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:24.230460 17078 raft_consensus.cc:504] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.230821 17078 leader_election.cc:288] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 (127.17.79.1:41805), e8046b5ad9f14056a20379f68fe49eac (127.17.79.3:35195)
I20260811 02:36:24.234923 17065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.231098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:57033 (local address 127.17.79.3:35195)
0811 02:36:24.231148 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.231150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.231352 (+ 202us) server_negotiation.cc:407] Connection header received
0811 02:36:24.231380 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.231381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.231388 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.231460 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:24.231588 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.232286 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.233922 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.234514 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.234592 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.234602 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.234809 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.234850 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 02:36:24.234923 17062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.231058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:36569 (local address 127.17.79.1:41805)
0811 02:36:24.231124 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.231126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.231139 (+ 13us) server_negotiation.cc:407] Connection header received
0811 02:36:24.231204 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.231205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.231215 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.231267 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:24.231467 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.232264 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.233922 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.234514 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.234592 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.234602 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.234809 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.234850 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 02:36:24.234936 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.230993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:41805 (local address 127.17.79.2:36569)
0811 02:36:24.231066 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.231079 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:24.231128 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:24.231299 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:24.231300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:24.231302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:24.231383 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.231385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.232403 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.232405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.233805 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.233809 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.234614 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.234615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.234709 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.234713 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:24.234787 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 02:36:24.234838 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":108}
I20260811 02:36:24.234942 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.231000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:35195 (local address 127.17.79.2:57033)
0811 02:36:24.231262 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.231272 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:24.231324 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:24.231467 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:24.231468 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:24.231469 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:24.231522 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.231523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.232403 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.232405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.233805 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:24.233809 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.234625 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.234625 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:24.234709 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.234713 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:24.234787 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 02:36:24.234836 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":144,"thread_start_us":102,"threads_started":1}
I20260811 02:36:24.235426 16503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6756c7c0fb874388b469e3e2a0e587c6" candidate_uuid: "363b2339b060408792645cfa7d900813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" is_pre_election: true
I20260811 02:36:24.235585 16503 raft_consensus.cc:2454] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363b2339b060408792645cfa7d900813 in term 0.
I20260811 02:36:24.235546 16974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6756c7c0fb874388b469e3e2a0e587c6" candidate_uuid: "363b2339b060408792645cfa7d900813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8046b5ad9f14056a20379f68fe49eac" is_pre_election: true
I20260811 02:36:24.235698 16974 raft_consensus.cc:2454] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363b2339b060408792645cfa7d900813 in term 0.
I20260811 02:36:24.235872 16619 leader_election.cc:302] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363b2339b060408792645cfa7d900813, b77c1fd8fb4d4dbc8fd5a0cfbb6d5618; no voters:
I20260811 02:36:24.236060 17078 raft_consensus.cc:2781] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:36:24.236119 17078 raft_consensus.cc:482] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:36:24.236145 17078 raft_consensus.cc:3037] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:24.236943 17078 raft_consensus.cc:504] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.237097 17078 leader_election.cc:288] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [CANDIDATE]: Term 1 election: Requested vote from peers b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 (127.17.79.1:41805), e8046b5ad9f14056a20379f68fe49eac (127.17.79.3:35195)
I20260811 02:36:24.237277 16503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6756c7c0fb874388b469e3e2a0e587c6" candidate_uuid: "363b2339b060408792645cfa7d900813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618"
I20260811 02:36:24.237308 16974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6756c7c0fb874388b469e3e2a0e587c6" candidate_uuid: "363b2339b060408792645cfa7d900813" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8046b5ad9f14056a20379f68fe49eac"
I20260811 02:36:24.237376 16974 raft_consensus.cc:3037] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:24.237365 16503 raft_consensus.cc:3037] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:24.238319 16503 raft_consensus.cc:2454] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363b2339b060408792645cfa7d900813 in term 1.
I20260811 02:36:24.238319 16974 raft_consensus.cc:2454] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363b2339b060408792645cfa7d900813 in term 1.
I20260811 02:36:24.238507 16620 leader_election.cc:302] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363b2339b060408792645cfa7d900813, e8046b5ad9f14056a20379f68fe49eac; no voters:
I20260811 02:36:24.238689 17078 raft_consensus.cc:2781] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:24.238890 17078 raft_consensus.cc:686] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 1 LEADER]: Becoming Leader. State: Replica: 363b2339b060408792645cfa7d900813, State: Running, Role: LEADER
I20260811 02:36:24.238996 17078 consensus_queue.cc:237] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } }
I20260811 02:36:24.240005 16254 catalog_manager.cc:5495] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 reported cstate change: term changed from 0 to 1, leader changed from <none> to 363b2339b060408792645cfa7d900813 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "363b2339b060408792645cfa7d900813" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363b2339b060408792645cfa7d900813" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 34885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 } health_report { overall_health: UNKNOWN } } }
I20260811 02:36:24.253201 17066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.250737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56840 (local address 127.17.79.2:34885)
0811 02:36:24.250798 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:24.250800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:24.250811 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:36:24.250860 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:24.250861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:24.250881 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:24.250963 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:36:24.251095 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.251579 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.252370 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:24.252561 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:24.252660 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:24.252828 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:36:24.252931 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:36:24.253023 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:24.253063 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 02:36:24.253085 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 02:36:24.255229 16503 raft_consensus.cc:1261] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 1 FOLLOWER]: Refusing update from remote peer 363b2339b060408792645cfa7d900813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:24.255237 16974 raft_consensus.cc:1261] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 1 FOLLOWER]: Refusing update from remote peer 363b2339b060408792645cfa7d900813: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:24.255613 17078 consensus_queue.cc:1035] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b77c1fd8fb4d4dbc8fd5a0cfbb6d5618" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:24.255734 17086 consensus_queue.cc:1035] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8046b5ad9f14056a20379f68fe49eac" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:24.258558 17090 mvcc.cc:205] Tried to move back new op lower bound from 7317159052306702336 to 7317159052243636224. Current Snapshot: MvccSnapshot[applied={T|T < 7317159052306702336}]
I20260811 02:36:24.258747 17091 mvcc.cc:205] Tried to move back new op lower bound from 7317159052306702336 to 7317159052243636224. Current Snapshot: MvccSnapshot[applied={T|T < 7317159052306702336}]
I20260811 02:36:24.259037 17094 mvcc.cc:205] Tried to move back new op lower bound from 7317159052306702336 to 7317159052243636224. Current Snapshot: MvccSnapshot[applied={T|T < 7317159052306702336}]
I20260811 02:36:24.261154 16257 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:24.261269 16257 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:24.262269 16257 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ecb621027574969999e25ac865b1626: Sending DeleteTablet for 3 replicas of tablet 6756c7c0fb874388b469e3e2a0e587c6
I20260811 02:36:24.262645 16703 tablet_service.cc:1514] Processing DeleteTablet for tablet 6756c7c0fb874388b469e3e2a0e587c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:24 UTC) from {username='slave'} at 127.0.0.1:57284
I20260811 02:36:24.262660 16468 tablet_service.cc:1514] Processing DeleteTablet for tablet 6756c7c0fb874388b469e3e2a0e587c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:24 UTC) from {username='slave'} at 127.0.0.1:46876
I20260811 02:36:24.262657 16931 tablet_service.cc:1514] Processing DeleteTablet for tablet 6756c7c0fb874388b469e3e2a0e587c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:24 UTC) from {username='slave'} at 127.0.0.1:34334
I20260811 02:36:24.262930 17107 tablet_replica.cc:330] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: stopping tablet replica
I20260811 02:36:24.263077 17108 tablet_replica.cc:330] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618: stopping tablet replica
I20260811 02:36:24.263204 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 16358
I20260811 02:36:24.263375 17107 raft_consensus.cc:2229] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:36:24.263505 17107 raft_consensus.cc:2258] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:24.263615 17108 raft_consensus.cc:2229] T 6756c7c0fb874388b469e3e2a0e587c6 P b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:24.266422 17110 tablet_replica.cc:330] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: stopping tablet replica
I20260811 02:36:24.266568 17110 raft_consensus.cc:2229] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:24.266701 17110 raft_consensus.cc:2258] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:24.267131 17107 ts_tablet_manager.cc:1905] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:24.270537 17110 ts_tablet_manager.cc:1905] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:24.272941 17110 ts_tablet_manager.cc:1918] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:24.273051 17110 log.cc:1196] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/6756c7c0fb874388b469e3e2a0e587c6
I20260811 02:36:24.273381 17110 ts_tablet_manager.cc:1939] T 6756c7c0fb874388b469e3e2a0e587c6 P e8046b5ad9f14056a20379f68fe49eac: Deleting consensus metadata
I20260811 02:36:24.274575 16232 catalog_manager.cc:4841] TS e8046b5ad9f14056a20379f68fe49eac (127.17.79.3:35195): tablet 6756c7c0fb874388b469e3e2a0e587c6 (table test-table [id=a45267e0f5df4a658e70e637b908544c]) successfully deleted
I20260811 02:36:24.279254 17107 ts_tablet_manager.cc:1918] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:24.279363 17107 log.cc:1196] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/6756c7c0fb874388b469e3e2a0e587c6
I20260811 02:36:24.279670 17107 ts_tablet_manager.cc:1939] T 6756c7c0fb874388b469e3e2a0e587c6 P 363b2339b060408792645cfa7d900813: Deleting consensus metadata
I20260811 02:36:24.280197 16234 catalog_manager.cc:4841] TS 363b2339b060408792645cfa7d900813 (127.17.79.2:34885): tablet 6756c7c0fb874388b469e3e2a0e587c6 (table test-table [id=a45267e0f5df4a658e70e637b908544c]) successfully deleted
W20260811 02:36:24.288481 16227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:41805 (error 108)
I20260811 02:36:24.288650 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 16593
I20260811 02:36:24.298051 17059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:24.297879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:41805 (local address 127.0.0.1:41546)
0811 02:36:24.297947 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:24.298000 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:41805: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 02:36:24.298189 16227 catalog_manager.cc:4584] TS b77c1fd8fb4d4dbc8fd5a0cfbb6d5618 (127.17.79.1:41805): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6756c7c0fb874388b469e3e2a0e587c6: Network error: Client connection negotiation failed: client connection to 127.17.79.1:41805: connect: Connection refused (error 111)
I20260811 02:36:24.303442 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 16820
I20260811 02:36:24.321954 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 16203
2026-08-11T02:36:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (780 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:24 dist-test-slave-7nm7 krb5kdc[17116](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:24 dist-test-slave-7nm7 krb5kdc[17116](info): set up 2 sockets
Aug 11 02:36:24 dist-test-slave-7nm7 krb5kdc[17116](info): commencing operation
krb5kdc: starting...
W20260811 02:36:25.647125 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:25 dist-test-slave-7nm7 krb5kdc[17116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:25.773928 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43053
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:41715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43053
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:25.857252 17137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:25.857509 17137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:25.857546 17137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:25.858691 17137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:25.858776 17137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:25.858800 17137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:25.858829 17137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:25.858860 17137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:25.860371 17137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:25.860661 17137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:25.860916 17137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:25.866039 17153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:25.866101 17154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:25.866070 17159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:25.866484 17137 server_base.cc:1034] running on GCE node
I20260811 02:36:25.866736 17137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:25.867029 17137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:25.868248 17137 hybrid_clock.cc:648] HybridClock initialized: now 1786415785868230 us; error 38 us; skew 500 ppm
Aug 11 02:36:25 dist-test-slave-7nm7 krb5kdc[17116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415785, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:25.870962 17137 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:25.871477 17137 webserver.cc:460] Webserver started at http://127.17.79.62:42455/ using document root <none> and password file <none>
I20260811 02:36:25.871747 17137 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:25.871815 17137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:25.871964 17137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:25.873044 17137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "a04b6392ac40443da11966b67c647005"
format_stamp: "Formatted at 2026-08-11 02:36:25 on dist-test-slave-7nm7"
server_key: "ef92932567e9b20e4dcb45225f39e36a"
server_key_iv: "4f0bb6891ee4679c86e09618f721e90e"
server_key_version: "encryptionkey@0"
I20260811 02:36:25.873405 17137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "a04b6392ac40443da11966b67c647005"
format_stamp: "Formatted at 2026-08-11 02:36:25 on dist-test-slave-7nm7"
server_key: "ef92932567e9b20e4dcb45225f39e36a"
server_key_iv: "4f0bb6891ee4679c86e09618f721e90e"
server_key_version: "encryptionkey@0"
I20260811 02:36:25.874950 17137 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:25.875787 17176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:25.875995 17137 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:25.876107 17137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "a04b6392ac40443da11966b67c647005"
format_stamp: "Formatted at 2026-08-11 02:36:25 on dist-test-slave-7nm7"
server_key: "ef92932567e9b20e4dcb45225f39e36a"
server_key_iv: "4f0bb6891ee4679c86e09618f721e90e"
server_key_version: "encryptionkey@0"
I20260811 02:36:25.876184 17137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:25.891454 17137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:25.893503 17137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:25.893671 17137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:25.898069 17137 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:43053
I20260811 02:36:25.898109 17262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:43053 every 8 connection(s)
I20260811 02:36:25.898514 17137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:25.899389 17267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:25.900056 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 17137
I20260811 02:36:25.900177 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:25.900375 17724 external_mini_cluster.cc:1428] Setting key c5b8b90f4dc3982467e16f087513c940
I20260811 02:36:25.902534 17267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005: Bootstrap starting.
I20260811 02:36:25.903308 17267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:25.903631 17267 log.cc:824] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:25.904356 17267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005: No bootstrap required, opened a new log
I20260811 02:36:25.906347 17267 raft_consensus.cc:348] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b6392ac40443da11966b67c647005" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43053 } }
I20260811 02:36:25.906476 17267 raft_consensus.cc:374] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:25.906498 17267 raft_consensus.cc:729] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04b6392ac40443da11966b67c647005, State: Initialized, Role: FOLLOWER
I20260811 02:36:25.906658 17267 consensus_queue.cc:260] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b6392ac40443da11966b67c647005" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43053 } }
I20260811 02:36:25.906760 17267 raft_consensus.cc:388] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:25.906795 17267 raft_consensus.cc:482] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:25.906877 17267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 02:36:25 dist-test-slave-7nm7 krb5kdc[17116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:25.907711 17267 raft_consensus.cc:504] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b6392ac40443da11966b67c647005" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43053 } }
I20260811 02:36:25.907829 17267 leader_election.cc:302] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a04b6392ac40443da11966b67c647005; no voters:
I20260811 02:36:25.909252 17267 leader_election.cc:288] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:25.909382 17274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:25.909607 17267 sys_catalog.cc:564] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:25.909825 17274 raft_consensus.cc:686] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [term 1 LEADER]: Becoming Leader. State: Replica: a04b6392ac40443da11966b67c647005, State: Running, Role: LEADER
I20260811 02:36:25.909983 17274 consensus_queue.cc:237] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b6392ac40443da11966b67c647005" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43053 } }
I20260811 02:36:25.910540 17274 sys_catalog.cc:455] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a04b6392ac40443da11966b67c647005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b6392ac40443da11966b67c647005" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43053 } } }
I20260811 02:36:25.910694 17274 sys_catalog.cc:458] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:25.910787 17277 sys_catalog.cc:455] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a04b6392ac40443da11966b67c647005. Latest consensus state: current_term: 1 leader_uuid: "a04b6392ac40443da11966b67c647005" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b6392ac40443da11966b67c647005" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43053 } } }
I20260811 02:36:25.911024 17277 sys_catalog.cc:458] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:25.912410 17272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:25.900894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39260 (local address 127.17.79.62:43053)
0811 02:36:25.901094 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:25.901103 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:25.901143 (+ 40us) server_negotiation.cc:407] Connection header received
0811 02:36:25.901716 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:25.901726 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:25.901788 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:25.901937 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:25.902621 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:25.903983 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:25.904812 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:25.905213 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:25.905336 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:25.907840 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:25.907845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:25.907845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:25.907857 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:25.909807 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:25.910252 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:25.910254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:25.910255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:25.910357 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:25.910597 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:25.910598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:25.910598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:25.910947 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:25.911571 (+ 624us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:25.911644 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 02:36:25.911797 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
W20260811 02:36:25.912729 17308 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:36:25.912786 17308 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:36:25.912850 17284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:25.913033 17284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:25.914727 17284 catalog_manager.cc:1347] Generated new cluster ID: 5f7e3df41b1843a7ad8b75b222256a4b
I20260811 02:36:25.914785 17284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:25.929191 17284 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:25.929898 17284 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:25.934398 17284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005: Generated new TSK 0
I20260811 02:36:25.934609 17284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:36:25.969105 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:43053
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:41715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:26.057343 17315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:26.057544 17315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:26.057569 17315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:26.058763 17315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:26.058804 17315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:26.058831 17315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:36:26.060298 17315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:43053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:26.060523 17315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:26.060772 17315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:26.065917 17321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.065925 17324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.065925 17327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:26.066165 17315 server_base.cc:1034] running on GCE node
I20260811 02:36:26.066406 17315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:26.066666 17315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:26.067840 17315 hybrid_clock.cc:648] HybridClock initialized: now 1786415786067833 us; error 35 us; skew 500 ppm
Aug 11 02:36:26 dist-test-slave-7nm7 krb5kdc[17116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:26.073720 17315 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:36:26.074311 17315 webserver.cc:460] Webserver started at http://127.17.79.1:37115/ using document root <none> and password file <none>
I20260811 02:36:26.074554 17315 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:26.074626 17315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:26.074800 17315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:26.075974 17315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "bc77a22c05ad4e289ecbd0b70b461ef2"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "3d29e5b8f08b6c6277353714eabb015a"
server_key_iv: "eac6167f8fa08cc60115086171027767"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.076429 17315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "bc77a22c05ad4e289ecbd0b70b461ef2"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "3d29e5b8f08b6c6277353714eabb015a"
server_key_iv: "eac6167f8fa08cc60115086171027767"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.077838 17315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:26.078641 17340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.078845 17315 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:36:26.078956 17315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "bc77a22c05ad4e289ecbd0b70b461ef2"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "3d29e5b8f08b6c6277353714eabb015a"
server_key_iv: "eac6167f8fa08cc60115086171027767"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.079049 17315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:26.091064 17315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:26.093314 17315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:26.093425 17315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:26.093614 17315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:26.093943 17315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:26.093981 17315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.094002 17315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:26.094038 17315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.099794 17315 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:34025
I20260811 02:36:26.099869 17548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:34025 every 8 connection(s)
I20260811 02:36:26.100195 17315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:36:26 dist-test-slave-7nm7 krb5kdc[17116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:26.106460 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 17315
I20260811 02:36:26.106567 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:36:26.106793 17724 external_mini_cluster.cc:1428] Setting key 1703cf92daa146485d1f1d3ec0912b70
I20260811 02:36:26.110316 17272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.100958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:42461 (local address 127.17.79.62:43053)
0811 02:36:26.101020 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.101022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.101219 (+ 197us) server_negotiation.cc:407] Connection header received
0811 02:36:26.101766 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.101768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.101782 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.101834 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:26.102830 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.103347 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.104330 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.104559 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.104643 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.107039 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:26.107040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:26.107040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:26.107046 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:26.108823 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.109238 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.109240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.109240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.109307 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.109543 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.109544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.109544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.109700 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:26.109779 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.110112 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.110191 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 02:36:26.110579 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.100937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43053 (local address 127.17.79.1:42461)
0811 02:36:26.101101 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.101136 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.101651 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.101906 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.101909 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.102519 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:26.102721 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.102726 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.103447 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.103448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.104236 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.104238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.104657 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.104658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.104791 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.105259 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:26.105270 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:26.106930 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:26.108911 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:26.108918 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:26.108920 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:26.109146 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:26.109375 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:26.109376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:26.109376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:26.109477 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:26.109784 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:26.109792 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:26.109963 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.110084 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.110292 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260811 02:36:26.111132 17550 heartbeater.cc:347] Connected to a master server at 127.17.79.62:43053
I20260811 02:36:26.111239 17550 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:26.111435 17550 heartbeater.cc:511] Master 127.17.79.62:43053 requested a full tablet report, sending...
I20260811 02:36:26.112002 17205 ts_manager.cc:194] Registered new tserver with Master: bc77a22c05ad4e289ecbd0b70b461ef2 (127.17.79.1:34025)
I20260811 02:36:26.112942 17205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:42461
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:36:26.134560 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:43053
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:41715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:26.219244 17561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:26.219444 17561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:26.219467 17561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:26.220602 17561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:26.220641 17561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:26.220667 17561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:36:26.222052 17561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:43053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:26.222278 17561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:26.222471 17561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:26.227806 17576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.227814 17574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:26.227911 17561 server_base.cc:1034] running on GCE node
W20260811 02:36:26.227830 17572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:26.228235 17561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:26.228479 17561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:26.229666 17561 hybrid_clock.cc:648] HybridClock initialized: now 1786415786229654 us; error 31 us; skew 500 ppm
Aug 11 02:36:26 dist-test-slave-7nm7 krb5kdc[17116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:26.232350 17561 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:36:26.232769 17561 webserver.cc:460] Webserver started at http://127.17.79.2:44157/ using document root <none> and password file <none>
I20260811 02:36:26.233016 17561 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:26.233093 17561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:26.233239 17561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:26.234321 17561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "57170f51fc42467cbf524a637c041ef6"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "874913ec884aff8ba442742c0c7d513b"
server_key_iv: "618ce618ae9e97023f2b5aa22fe63524"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.234668 17561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "57170f51fc42467cbf524a637c041ef6"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "874913ec884aff8ba442742c0c7d513b"
server_key_iv: "618ce618ae9e97023f2b5aa22fe63524"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.235972 17561 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:26.236681 17596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.236861 17561 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 02:36:26.236968 17561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "57170f51fc42467cbf524a637c041ef6"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "874913ec884aff8ba442742c0c7d513b"
server_key_iv: "618ce618ae9e97023f2b5aa22fe63524"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.237066 17561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:26.255033 17561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:26.257704 17561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:26.257881 17561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:26.258140 17561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:26.258507 17561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:26.258564 17561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.258607 17561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:26.258633 17561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.264707 17561 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:39531
I20260811 02:36:26.264822 17813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:39531 every 8 connection(s)
I20260811 02:36:26.265121 17561 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:36:26.270560 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 17561
I20260811 02:36:26.270645 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:36:26.270836 17724 external_mini_cluster.cc:1428] Setting key ad6339c6a260d5a18e685e0626577b11
Aug 11 02:36:26 dist-test-slave-7nm7 krb5kdc[17116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:26.275512 17272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.265920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:60141 (local address 127.17.79.62:43053)
0811 02:36:26.265967 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.265969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.266307 (+ 338us) server_negotiation.cc:407] Connection header received
0811 02:36:26.266806 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.266807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.266817 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.266871 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:26.267804 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.268348 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.269340 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.269530 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.269594 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.272113 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:26.272115 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:26.272115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:26.272129 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:26.273850 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.274426 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.274428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.274429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.274511 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.274798 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.274800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.274801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.274964 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:26.275037 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.275372 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.275448 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:36:26.275813 17816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.265891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43053 (local address 127.17.79.2:60141)
0811 02:36:26.266130 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.266168 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.266713 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.266920 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.266924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.267493 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:26.267685 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.267689 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.268440 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.268441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.269250 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.269252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.269610 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.269611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.269720 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.270345 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:26.270354 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:26.271971 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:26.273944 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:26.273951 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:26.273953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:26.274177 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:26.274600 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:26.274601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:26.274602 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:26.274722 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:26.275048 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:26.275055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:26.275222 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.275340 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.275521 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":94,"threads_started":1}
I20260811 02:36:26.276487 17814 heartbeater.cc:347] Connected to a master server at 127.17.79.62:43053
I20260811 02:36:26.276620 17814 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:26.276849 17814 heartbeater.cc:511] Master 127.17.79.62:43053 requested a full tablet report, sending...
I20260811 02:36:26.277293 17205 ts_manager.cc:194] Registered new tserver with Master: 57170f51fc42467cbf524a637c041ef6 (127.17.79.2:39531)
I20260811 02:36:26.277786 17205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:60141
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:36:26.301157 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:43053
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:41715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:26.384372 17820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:26.384581 17820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:26.384605 17820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:26.385742 17820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:26.385785 17820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:26.385812 17820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:36:26.387490 17820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:43053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:26.387741 17820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:26.387979 17820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:26.393035 17832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.393067 17828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.393070 17834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:26.393471 17820 server_base.cc:1034] running on GCE node
I20260811 02:36:26.394004 17820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:26.394398 17820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:26.395562 17820 hybrid_clock.cc:648] HybridClock initialized: now 1786415786395550 us; error 31 us; skew 500 ppm
Aug 11 02:36:26 dist-test-slave-7nm7 krb5kdc[17116](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:26.398397 17820 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:36:26.398856 17820 webserver.cc:460] Webserver started at http://127.17.79.3:39871/ using document root <none> and password file <none>
I20260811 02:36:26.399225 17820 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:26.399294 17820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:26.399463 17820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:26.400549 17820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "bd09d6f735a94f14a4c1e663204cd6ca"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "656bf81014d91ccee4d5bd37e2ba7f62"
server_key_iv: "10b37c4231a1ef6ab8b17f5db28a5527"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.400929 17820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "bd09d6f735a94f14a4c1e663204cd6ca"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "656bf81014d91ccee4d5bd37e2ba7f62"
server_key_iv: "10b37c4231a1ef6ab8b17f5db28a5527"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.402400 17820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:26.403365 17847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.403656 17820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:26.403760 17820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "bd09d6f735a94f14a4c1e663204cd6ca"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "656bf81014d91ccee4d5bd37e2ba7f62"
server_key_iv: "10b37c4231a1ef6ab8b17f5db28a5527"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.403848 17820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:26.415982 17820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:26.418097 17820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:26.418330 17820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:26.418623 17820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:26.418946 17820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:26.419003 17820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.419046 17820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:26.419073 17820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.425330 17820 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:34339
I20260811 02:36:26.425382 18059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:34339 every 8 connection(s)
I20260811 02:36:26.425722 17820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:36:26.427029 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 17820
I20260811 02:36:26.427310 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:36:26.427538 17724 external_mini_cluster.cc:1428] Setting key 4f41d23a3ef336e4ceff971dc8905548
Aug 11 02:36:26 dist-test-slave-7nm7 krb5kdc[17116](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415786, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:26.435443 17272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.426553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:57991 (local address 127.17.79.62:43053)
0811 02:36:26.426623 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.426626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.426865 (+ 239us) server_negotiation.cc:407] Connection header received
0811 02:36:26.427475 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.427477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.427490 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.427541 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:26.428733 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.429247 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.430263 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.430469 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.430558 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.432798 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:26.432800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:26.432800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:26.432808 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:26.434028 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.434597 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.434598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.434598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.434658 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.434909 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.434910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.434910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.435021 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:26.435082 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.435314 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.435380 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:36:26.435606 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.426536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43053 (local address 127.17.79.3:57991)
0811 02:36:26.426722 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.426758 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.427353 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.427610 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.427615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.428364 (+ 749us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:26.428632 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.428637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.429351 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.429352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.430158 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.430160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.430569 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.430571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.430713 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.431216 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:26.431224 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:26.432701 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:26.434164 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:26.434171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:26.434173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:26.434503 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:26.434733 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:26.434734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:26.434734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:26.434831 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:26.435085 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:26.435090 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:26.435204 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.435289 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.435406 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":73,"threads_started":1}
I20260811 02:36:26.436095 18063 heartbeater.cc:347] Connected to a master server at 127.17.79.62:43053
I20260811 02:36:26.436189 18063 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:26.436324 18063 heartbeater.cc:511] Master 127.17.79.62:43053 requested a full tablet report, sending...
I20260811 02:36:26.436704 17205 ts_manager.cc:194] Registered new tserver with Master: bd09d6f735a94f14a4c1e663204cd6ca (127.17.79.3:34339)
I20260811 02:36:26.437060 17205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:57991
I20260811 02:36:26.439316 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:36:26.448192 17272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.440998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39270 (local address 127.17.79.62:43053)
0811 02:36:26.441046 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.441048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.441174 (+ 126us) server_negotiation.cc:407] Connection header received
0811 02:36:26.441246 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.441247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.441258 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.441335 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:26.442168 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.442933 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.443909 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.444139 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.444203 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.445884 (+ 1681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:26.445886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:26.445886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:26.445893 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:26.447132 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.447486 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.447487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.447487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.447538 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:26.447733 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:26.447733 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:26.447733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:26.447848 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:26.447927 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.448024 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.448074 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 02:36:26.449800 17205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:36:26.451732 17205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:36:26.458252 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.453994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.17.79.3:34339)
0811 02:36:26.454191 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.454196 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.454301 (+ 105us) server_negotiation.cc:407] Connection header received
0811 02:36:26.454442 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.454444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.454460 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.454549 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:26.454722 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.455659 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457306 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.457777 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457863 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.457921 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.458091 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.458137 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
I20260811 02:36:26.458220 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.453902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:34339 (local address 127.0.0.1:33684)
0811 02:36:26.454172 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.454212 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.454344 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.454567 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.454570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.454572 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:26.454645 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.454647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.455758 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.455759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.457243 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.457245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.457864 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.457951 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.457968 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.458066 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.458131 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":3,"thread_start_us":75,"threads_started":1}
I20260811 02:36:26.458415 18085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.454400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44364 (local address 127.17.79.1:34025)
0811 02:36:26.454585 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.454589 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.454985 (+ 396us) server_negotiation.cc:407] Connection header received
0811 02:36:26.455027 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.455029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.455044 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.455116 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:26.455244 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.456231 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457180 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.457883 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457961 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.458019 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.458289 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.458335 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260811 02:36:26.458529 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.454138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:34025 (local address 127.0.0.1:44364)
0811 02:36:26.454866 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.454877 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.454925 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.455128 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.455129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.455131 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:26.455182 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.455184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.456337 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.456338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.457073 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.457075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.458056 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.458058 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.458117 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.458121 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.458172 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.458224 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"thread_start_us":81,"threads_started":1}
I20260811 02:36:26.459012 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.454105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45324 (local address 127.17.79.2:39531)
0811 02:36:26.454588 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.454592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.454602 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:36:26.454641 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.454643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.454657 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.454772 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:26.454902 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.455995 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457243 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.457915 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457978 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.458024 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.458182 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.458226 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":86,"threads_started":1}
I20260811 02:36:26.459214 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.453937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:39531 (local address 127.0.0.1:45324)
0811 02:36:26.454274 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.454287 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.454345 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.454756 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.454758 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.454760 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:26.454813 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.454814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.456097 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.456099 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.457169 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.457171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.457978 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.457979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.458041 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.458045 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.458094 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.458131 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":3,"thread_start_us":78,"threads_started":1}
I20260811 02:36:26.459527 17429 tablet_service.cc:1467] Processing CreateTablet for tablet 70ae6198e48b4099a0194cc8d6be2c63 (DEFAULT_TABLE table=test-table [id=423e79ffcd6c4a9da27836bf8a41f411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:26.459885 17429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ae6198e48b4099a0194cc8d6be2c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:26.459883 17682 tablet_service.cc:1467] Processing CreateTablet for tablet 70ae6198e48b4099a0194cc8d6be2c63 (DEFAULT_TABLE table=test-table [id=423e79ffcd6c4a9da27836bf8a41f411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:26.460202 17682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ae6198e48b4099a0194cc8d6be2c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:26.463088 18087 tablet_bootstrap.cc:492] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Bootstrap starting.
I20260811 02:36:26.463732 17935 tablet_service.cc:1467] Processing CreateTablet for tablet 70ae6198e48b4099a0194cc8d6be2c63 (DEFAULT_TABLE table=test-table [id=423e79ffcd6c4a9da27836bf8a41f411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:26.463966 18087 tablet_bootstrap.cc:654] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:26.464079 17935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ae6198e48b4099a0194cc8d6be2c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:26.464571 18087 log.cc:824] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:26.465415 18087 tablet_bootstrap.cc:492] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: No bootstrap required, opened a new log
I20260811 02:36:26.465562 18087 ts_tablet_manager.cc:1397] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:36:26.466989 18092 tablet_bootstrap.cc:492] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: Bootstrap starting.
I20260811 02:36:26.467555 18096 tablet_bootstrap.cc:492] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Bootstrap starting.
I20260811 02:36:26.467653 18092 tablet_bootstrap.cc:654] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:26.467978 18087 raft_consensus.cc:348] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.468142 18087 raft_consensus.cc:374] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:26.468186 18087 raft_consensus.cc:729] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57170f51fc42467cbf524a637c041ef6, State: Initialized, Role: FOLLOWER
I20260811 02:36:26.468320 18087 consensus_queue.cc:260] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.468358 18092 log.cc:824] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:26.468431 18096 tablet_bootstrap.cc:654] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:26.468605 18087 ts_tablet_manager.cc:1428] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:36:26.468751 17814 heartbeater.cc:503] Master 127.17.79.62:43053 was elected leader, sending a full tablet report...
I20260811 02:36:26.468995 18096 log.cc:824] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:26.469159 18092 tablet_bootstrap.cc:492] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: No bootstrap required, opened a new log
I20260811 02:36:26.469249 18092 ts_tablet_manager.cc:1397] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:36:26.470793 18096 tablet_bootstrap.cc:492] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: No bootstrap required, opened a new log
I20260811 02:36:26.470877 18096 ts_tablet_manager.cc:1397] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 02:36:26.471166 18092 raft_consensus.cc:348] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.471307 18092 raft_consensus.cc:374] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:26.471328 18092 raft_consensus.cc:729] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc77a22c05ad4e289ecbd0b70b461ef2, State: Initialized, Role: FOLLOWER
I20260811 02:36:26.471443 18092 consensus_queue.cc:260] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.471743 18092 ts_tablet_manager.cc:1428] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:36:26.471777 17550 heartbeater.cc:503] Master 127.17.79.62:43053 was elected leader, sending a full tablet report...
I20260811 02:36:26.472831 18096 raft_consensus.cc:348] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.472975 18096 raft_consensus.cc:374] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:26.472998 18096 raft_consensus.cc:729] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd09d6f735a94f14a4c1e663204cd6ca, State: Initialized, Role: FOLLOWER
I20260811 02:36:26.473091 18096 consensus_queue.cc:260] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.473310 18096 ts_tablet_manager.cc:1428] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 02:36:26.473369 18063 heartbeater.cc:503] Master 127.17.79.62:43053 was elected leader, sending a full tablet report...
W20260811 02:36:26.515748 17815 tablet.cc:2369] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:26.578716 18105 raft_consensus.cc:482] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:26.578856 18105 raft_consensus.cc:504] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.579281 18105 leader_election.cc:288] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc77a22c05ad4e289ecbd0b70b461ef2 (127.17.79.1:34025), 57170f51fc42467cbf524a637c041ef6 (127.17.79.2:39531)
I20260811 02:36:26.582800 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.579699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:45225 (local address 127.17.79.2:39531)
0811 02:36:26.579750 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.579753 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.579963 (+ 210us) server_negotiation.cc:407] Connection header received
0811 02:36:26.580016 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.580017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.580030 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.580112 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:26.580370 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.580893 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.581918 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.582434 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.582525 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.582555 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.582696 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.582737 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:36:26.582815 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.579610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:39531 (local address 127.17.79.3:45225)
0811 02:36:26.579876 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.579889 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.579957 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.580142 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.580143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.580145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:26.580229 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.580230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.580975 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.580976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.581840 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.581843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.582526 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.582527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.582602 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.582612 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.582674 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.582722 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":27,"thread_start_us":149,"threads_started":1}
I20260811 02:36:26.582899 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.579610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:34025 (local address 127.17.79.3:54313)
0811 02:36:26.579694 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.579706 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:26.579752 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:26.579914 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:26.579915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:26.579917 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:26.580012 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.580014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.580822 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.580823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.581770 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:26.581773 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.582620 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.582621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:26.582704 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.582709 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:36:26.582789 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 02:36:26.582830 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 02:36:26.582901 18085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.579697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:54313 (local address 127.17.79.1:34025)
0811 02:36:26.579750 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.579753 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.579765 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:36:26.579805 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.579806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.579820 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.579911 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:26.580176 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.580725 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.581872 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.582533 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.582622 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.582633 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.582797 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.582840 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:36:26.583262 17713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ae6198e48b4099a0194cc8d6be2c63" candidate_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57170f51fc42467cbf524a637c041ef6" is_pre_election: true
I20260811 02:36:26.583261 17468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ae6198e48b4099a0194cc8d6be2c63" candidate_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" is_pre_election: true
I20260811 02:36:26.583441 17713 raft_consensus.cc:2454] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd09d6f735a94f14a4c1e663204cd6ca in term 0.
I20260811 02:36:26.583441 17468 raft_consensus.cc:2454] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd09d6f735a94f14a4c1e663204cd6ca in term 0.
I20260811 02:36:26.583686 17855 leader_election.cc:302] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57170f51fc42467cbf524a637c041ef6, bd09d6f735a94f14a4c1e663204cd6ca; no voters:
I20260811 02:36:26.583866 18105 raft_consensus.cc:2781] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:36:26.583953 18105 raft_consensus.cc:482] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:36:26.583990 18105 raft_consensus.cc:3037] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:26.584760 18105 raft_consensus.cc:504] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.584919 18105 leader_election.cc:288] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [CANDIDATE]: Term 1 election: Requested vote from peers bc77a22c05ad4e289ecbd0b70b461ef2 (127.17.79.1:34025), 57170f51fc42467cbf524a637c041ef6 (127.17.79.2:39531)
I20260811 02:36:26.585069 17468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ae6198e48b4099a0194cc8d6be2c63" candidate_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2"
I20260811 02:36:26.585139 17713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ae6198e48b4099a0194cc8d6be2c63" candidate_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57170f51fc42467cbf524a637c041ef6"
I20260811 02:36:26.585166 17468 raft_consensus.cc:3037] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:26.585209 17713 raft_consensus.cc:3037] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:26.586131 17713 raft_consensus.cc:2454] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd09d6f735a94f14a4c1e663204cd6ca in term 1.
I20260811 02:36:26.586131 17468 raft_consensus.cc:2454] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd09d6f735a94f14a4c1e663204cd6ca in term 1.
I20260811 02:36:26.586326 17855 leader_election.cc:302] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57170f51fc42467cbf524a637c041ef6, bd09d6f735a94f14a4c1e663204cd6ca; no voters:
I20260811 02:36:26.586504 18105 raft_consensus.cc:2781] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:26.586735 18105 raft_consensus.cc:686] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 1 LEADER]: Becoming Leader. State: Replica: bd09d6f735a94f14a4c1e663204cd6ca, State: Running, Role: LEADER
I20260811 02:36:26.586848 18105 consensus_queue.cc:237] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } }
I20260811 02:36:26.587826 17203 catalog_manager.cc:5495] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca reported cstate change: term changed from 0 to 1, leader changed from <none> to bd09d6f735a94f14a4c1e663204cd6ca (127.17.79.3). New cstate: current_term: 1 leader_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd09d6f735a94f14a4c1e663204cd6ca" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 34339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 } health_report { overall_health: UNKNOWN } } }
W20260811 02:36:26.601011 17551 tablet.cc:2369] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:26.604099 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.601899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33686 (local address 127.17.79.3:34339)
0811 02:36:26.601941 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.601943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.601960 (+ 17us) server_negotiation.cc:407] Connection header received
0811 02:36:26.601991 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.601992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.602009 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.602074 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:36:26.602167 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.602753 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.603486 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.603663 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.603725 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.603836 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:36:26.603914 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:36:26.603979 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.604020 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.604028 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:36:26.605965 17468 raft_consensus.cc:1261] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 1 FOLLOWER]: Refusing update from remote peer bd09d6f735a94f14a4c1e663204cd6ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:26.605965 17713 raft_consensus.cc:1261] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 1 FOLLOWER]: Refusing update from remote peer bd09d6f735a94f14a4c1e663204cd6ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:26.606333 18105 consensus_queue.cc:1035] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "57170f51fc42467cbf524a637c041ef6" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 39531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:26.606482 18108 consensus_queue.cc:1035] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc77a22c05ad4e289ecbd0b70b461ef2" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 34025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:26.608953 18116 mvcc.cc:205] Tried to move back new op lower bound from 7317159061935067136 to 7317159061860601856. Current Snapshot: MvccSnapshot[applied={T|T < 7317159061935067136}]
I20260811 02:36:26.609563 18115 mvcc.cc:205] Tried to move back new op lower bound from 7317159061935067136 to 7317159061860601856. Current Snapshot: MvccSnapshot[applied={T|T < 7317159061935067136}]
I20260811 02:36:26.609687 18114 mvcc.cc:205] Tried to move back new op lower bound from 7317159061935067136 to 7317159061860601856. Current Snapshot: MvccSnapshot[applied={T|T < 7317159061935067136 or (T in {7317159061935067136})}]
I20260811 02:36:26.611258 17203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:26.611361 17203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:26.612104 17203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a04b6392ac40443da11966b67c647005: Sending DeleteTablet for 3 replicas of tablet 70ae6198e48b4099a0194cc8d6be2c63
I20260811 02:36:26.612449 17682 tablet_service.cc:1514] Processing DeleteTablet for tablet 70ae6198e48b4099a0194cc8d6be2c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:26 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:45324
I20260811 02:36:26.612485 17429 tablet_service.cc:1514] Processing DeleteTablet for tablet 70ae6198e48b4099a0194cc8d6be2c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:26 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:44364
I20260811 02:36:26.612494 17935 tablet_service.cc:1514] Processing DeleteTablet for tablet 70ae6198e48b4099a0194cc8d6be2c63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:26 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:33684
I20260811 02:36:26.612645 18130 tablet_replica.cc:330] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2: stopping tablet replica
I20260811 02:36:26.612751 18130 raft_consensus.cc:2229] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:26.612823 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 17315
I20260811 02:36:26.612855 18130 raft_consensus.cc:2258] T 70ae6198e48b4099a0194cc8d6be2c63 P bc77a22c05ad4e289ecbd0b70b461ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:26.612994 18133 tablet_replica.cc:330] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: stopping tablet replica
I20260811 02:36:26.613060 18133 raft_consensus.cc:2229] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:36:26.615818 18133 raft_consensus.cc:2258] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:26.623350 18131 tablet_replica.cc:330] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: stopping tablet replica
I20260811 02:36:26.623543 18131 raft_consensus.cc:2229] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:26.623729 18131 raft_consensus.cc:2258] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:26.626452 18133 ts_tablet_manager.cc:1905] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:26.628234 18131 ts_tablet_manager.cc:1905] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:26.628297 18133 ts_tablet_manager.cc:1918] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:26.628499 18133 log.cc:1196] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/70ae6198e48b4099a0194cc8d6be2c63
I20260811 02:36:26.628867 18133 ts_tablet_manager.cc:1939] T 70ae6198e48b4099a0194cc8d6be2c63 P bd09d6f735a94f14a4c1e663204cd6ca: Deleting consensus metadata
I20260811 02:36:26.629375 17178 catalog_manager.cc:4841] TS bd09d6f735a94f14a4c1e663204cd6ca (127.17.79.3:34339): tablet 70ae6198e48b4099a0194cc8d6be2c63 (table test-table [id=423e79ffcd6c4a9da27836bf8a41f411]) successfully deleted
I20260811 02:36:26.630280 18131 ts_tablet_manager.cc:1918] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:26.630365 18131 log.cc:1196] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/70ae6198e48b4099a0194cc8d6be2c63
I20260811 02:36:26.630661 18131 ts_tablet_manager.cc:1939] T 70ae6198e48b4099a0194cc8d6be2c63 P 57170f51fc42467cbf524a637c041ef6: Deleting consensus metadata
I20260811 02:36:26.631153 17181 catalog_manager.cc:4841] TS 57170f51fc42467cbf524a637c041ef6 (127.17.79.2:39531): tablet 70ae6198e48b4099a0194cc8d6be2c63 (table test-table [id=423e79ffcd6c4a9da27836bf8a41f411]) successfully deleted
W20260811 02:36:26.633078 17178 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:34025 (error 108)
I20260811 02:36:26.633388 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 17561
I20260811 02:36:26.633716 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.633601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:34025 (local address 127.0.0.1:44368)
0811 02:36:26.633645 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:26.633670 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:34025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 02:36:26.633819 17178 catalog_manager.cc:4584] TS bc77a22c05ad4e289ecbd0b70b461ef2 (127.17.79.1:34025): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 70ae6198e48b4099a0194cc8d6be2c63: Network error: Client connection negotiation failed: client connection to 127.17.79.1:34025: connect: Connection refused (error 111)
I20260811 02:36:26.643712 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 17820
I20260811 02:36:26.664279 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 17137
2026-08-11T02:36:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2340 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T02:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:26Z Disabled control of system clock
I20260811 02:36:26.699455 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33047
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:37353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:33047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:26.780869 18140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:26.781095 18140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:26.781116 18140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:26.782220 18140 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:26.782277 18140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:26.782291 18140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:26.782305 18140 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:26.782316 18140 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:26.783612 18140 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:33047
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:26.783805 18140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:26.784058 18140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:26.789134 18151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.789147 18150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.789237 18155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:26.789212 18140 server_base.cc:1034] running on GCE node
I20260811 02:36:26.789752 18140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:26.790088 18140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:26.791261 18140 hybrid_clock.cc:648] HybridClock initialized: now 1786415786791244 us; error 48 us; skew 500 ppm
I20260811 02:36:26.792622 18140 webserver.cc:460] Webserver started at http://127.17.79.62:46609/ using document root <none> and password file <none>
I20260811 02:36:26.792919 18140 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:26.792996 18140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:26.793154 18140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:26.794332 18140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "7550e316056392c2fe80958de340b35a"
server_key_iv: "1da337e4897600621bd9f5aaeb84b838"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.794699 18140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "7550e316056392c2fe80958de340b35a"
server_key_iv: "1da337e4897600621bd9f5aaeb84b838"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.796080 18140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:36:26.796909 18170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.797108 18140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:26.797230 18140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "7550e316056392c2fe80958de340b35a"
server_key_iv: "1da337e4897600621bd9f5aaeb84b838"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.797310 18140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:26.807873 18140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:26.808219 18140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:26.808382 18140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:26.812754 18140 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:33047
I20260811 02:36:26.812788 18278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:33047 every 8 connection(s)
I20260811 02:36:26.813151 18140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:26.814143 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18140
I20260811 02:36:26.814206 18279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:26.814412 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:26.814669 17724 external_mini_cluster.cc:1428] Setting key 5f7ac93c2f49b8e8d4aabfa7c96a9970
I20260811 02:36:26.817178 18279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2: Bootstrap starting.
I20260811 02:36:26.817819 18279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:26.818121 18279 log.cc:824] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:26.818882 18279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2: No bootstrap required, opened a new log
I20260811 02:36:26.820830 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:26.815436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55764 (local address 127.17.79.62:33047)
0811 02:36:26.815648 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:26.815656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:26.815689 (+ 33us) server_negotiation.cc:407] Connection header received
0811 02:36:26.816114 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:26.816121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:26.816180 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:26.816297 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:26.816697 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.817858 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.818821 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:26.819295 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:26.819444 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:26.820203 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:26.820207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:26.820208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:26.820389 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:26.820422 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:26.820432 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:26.820504 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:26.820583 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 02:36:26.820665 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
I20260811 02:36:26.821008 18279 raft_consensus.cc:348] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33047 } }
I20260811 02:36:26.821205 18279 raft_consensus.cc:374] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:26.821247 18279 raft_consensus.cc:729] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a303e7dc6a134e18bfbc54aa0bf87fc2, State: Initialized, Role: FOLLOWER
I20260811 02:36:26.821385 18279 consensus_queue.cc:260] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33047 } }
I20260811 02:36:26.821480 18279 raft_consensus.cc:388] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:26.821537 18279 raft_consensus.cc:482] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:26.821584 18279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:26.822149 18279 raft_consensus.cc:504] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33047 } }
I20260811 02:36:26.822290 18279 leader_election.cc:302] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a303e7dc6a134e18bfbc54aa0bf87fc2; no voters:
I20260811 02:36:26.822620 18279 leader_election.cc:288] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:26.822662 18296 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:26.822836 18296 raft_consensus.cc:686] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [term 1 LEADER]: Becoming Leader. State: Replica: a303e7dc6a134e18bfbc54aa0bf87fc2, State: Running, Role: LEADER
I20260811 02:36:26.822937 18279 sys_catalog.cc:564] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:26.822932 18296 consensus_queue.cc:237] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33047 } }
I20260811 02:36:26.823344 18298 sys_catalog.cc:455] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a303e7dc6a134e18bfbc54aa0bf87fc2. Latest consensus state: current_term: 1 leader_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33047 } } }
I20260811 02:36:26.823618 18298 sys_catalog.cc:458] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:26.823535 18297 sys_catalog.cc:455] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a303e7dc6a134e18bfbc54aa0bf87fc2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33047 } } }
I20260811 02:36:26.823910 18297 sys_catalog.cc:458] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:26.823936 18309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:26.824421 18309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:26.826215 18309 catalog_manager.cc:1347] Generated new cluster ID: df1469491a1b49c3beaffc3e21d01704
I20260811 02:36:26.826303 18309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:26.832286 18309 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:26.833065 18309 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:26.839767 18309 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2: Generated new TSK 0
I20260811 02:36:26.839963 18309 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:26.846506 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33047
--builtin_ntp_servers=127.17.79.20:37353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:26.932554 18328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:26.932799 18328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:26.932835 18328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:26.933984 18328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:26.934048 18328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:26.934092 18328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:36:26.935530 18328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:26.935819 18328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:26.936137 18328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:26.943317 18334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.943414 18335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:26.943773 18338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:26.944422 18328 server_base.cc:1034] running on GCE node
I20260811 02:36:26.944666 18328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:26.944941 18328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:26.946171 18328 hybrid_clock.cc:648] HybridClock initialized: now 1786415786946150 us; error 33 us; skew 500 ppm
I20260811 02:36:26.947657 18328 webserver.cc:460] Webserver started at http://127.17.79.1:39949/ using document root <none> and password file <none>
I20260811 02:36:26.947960 18328 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:26.948036 18328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:26.948199 18328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:26.949309 18328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "47880aaf875c4b18a3eb5ad0bbb04f04"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "e5854213e92e9bea57675029e519e431"
server_key_iv: "8e2ada1661419d4ee7454fc478aa7bae"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.949684 18328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "47880aaf875c4b18a3eb5ad0bbb04f04"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "e5854213e92e9bea57675029e519e431"
server_key_iv: "8e2ada1661419d4ee7454fc478aa7bae"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.951148 18328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:36:26.951970 18349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.952229 18328 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:26.952355 18328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "47880aaf875c4b18a3eb5ad0bbb04f04"
format_stamp: "Formatted at 2026-08-11 02:36:26 on dist-test-slave-7nm7"
server_key: "e5854213e92e9bea57675029e519e431"
server_key_iv: "8e2ada1661419d4ee7454fc478aa7bae"
server_key_version: "encryptionkey@0"
I20260811 02:36:26.952436 18328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:26.996037 18328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:26.996344 18328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:26.996454 18328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:26.996655 18328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:26.997021 18328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:26.997056 18328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:26.997112 18328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:26.997139 18328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:27.003396 18328 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:36483
I20260811 02:36:27.003492 18548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:36483 every 8 connection(s)
I20260811 02:36:27.003858 18328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:36:27.009313 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.004614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:49209 (local address 127.17.79.62:33047)
0811 02:36:27.004663 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.004665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.004908 (+ 243us) server_negotiation.cc:407] Connection header received
0811 02:36:27.005463 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.005464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.005483 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.005543 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:27.006273 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.006870 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.007880 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.008080 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.008157 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.009010 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:27.009011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:27.009012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:27.009016 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:27.009032 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:27.009039 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:27.009099 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.009194 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.009231 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:36:27.009548 18553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.004580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33047 (local address 127.17.79.1:49209)
0811 02:36:27.004775 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.004810 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.005351 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.005609 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.005613 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.005624 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:27.006144 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.006148 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.006983 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.006984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.007778 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.007780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.008169 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.008170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.008300 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.008852 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:27.008853 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:27.008881 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:27.008903 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:27.009100 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:27.009107 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:27.009110 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.009195 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.009296 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
I20260811 02:36:27.010218 18550 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33047
I20260811 02:36:27.010370 18550 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:27.010555 18550 heartbeater.cc:511] Master 127.17.79.62:33047 requested a full tablet report, sending...
I20260811 02:36:27.011054 18203 ts_manager.cc:194] Registered new tserver with Master: 47880aaf875c4b18a3eb5ad0bbb04f04 (127.17.79.1:36483)
I20260811 02:36:27.011687 18203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.1:49209
I20260811 02:36:27.013716 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18328
I20260811 02:36:27.013801 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:36:27.013979 17724 external_mini_cluster.cc:1428] Setting key cfaf6839c304b1c07d4d7a03cf33ce1b
I20260811 02:36:27.014964 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33047
--builtin_ntp_servers=127.17.79.20:37353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:27.099799 18554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:27.100061 18554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:27.100095 18554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:27.101449 18554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:27.101511 18554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:27.101557 18554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:36:27.103283 18554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:27.103586 18554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:27.103916 18554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:27.109161 18563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:27.109326 18554 server_base.cc:1034] running on GCE node
W20260811 02:36:27.109236 18567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:27.109153 18562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:27.109686 18554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:27.109901 18554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:27.111099 18554 hybrid_clock.cc:648] HybridClock initialized: now 1786415787111086 us; error 43 us; skew 500 ppm
I20260811 02:36:27.112624 18554 webserver.cc:460] Webserver started at http://127.17.79.2:45573/ using document root <none> and password file <none>
I20260811 02:36:27.112890 18554 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:27.112963 18554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:27.113116 18554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:27.114336 18554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "2c6302d8c75843bfa2a59498b10f9846"
format_stamp: "Formatted at 2026-08-11 02:36:27 on dist-test-slave-7nm7"
server_key: "ef382ce65f9ad8677ab268108c1b66d7"
server_key_iv: "3e985573b650085e9b1d647ea588db6f"
server_key_version: "encryptionkey@0"
I20260811 02:36:27.114703 18554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "2c6302d8c75843bfa2a59498b10f9846"
format_stamp: "Formatted at 2026-08-11 02:36:27 on dist-test-slave-7nm7"
server_key: "ef382ce65f9ad8677ab268108c1b66d7"
server_key_iv: "3e985573b650085e9b1d647ea588db6f"
server_key_version: "encryptionkey@0"
I20260811 02:36:27.116091 18554 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:27.116918 18575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:27.117275 18554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:27.117532 18554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "2c6302d8c75843bfa2a59498b10f9846"
format_stamp: "Formatted at 2026-08-11 02:36:27 on dist-test-slave-7nm7"
server_key: "ef382ce65f9ad8677ab268108c1b66d7"
server_key_iv: "3e985573b650085e9b1d647ea588db6f"
server_key_version: "encryptionkey@0"
I20260811 02:36:27.117658 18554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:27.165881 18554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:27.166266 18554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:27.166431 18554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:27.166697 18554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:27.167057 18554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:27.167112 18554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:27.167155 18554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:27.167203 18554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:27.173321 18554 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:37069
I20260811 02:36:27.173367 18781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:37069 every 8 connection(s)
I20260811 02:36:27.173743 18554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:36:27.179586 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.174884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:32775 (local address 127.17.79.62:33047)
0811 02:36:27.174990 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.174992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.175181 (+ 189us) server_negotiation.cc:407] Connection header received
0811 02:36:27.175672 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.175673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.175684 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.175765 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:27.176473 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.177050 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.178104 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.178313 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.178379 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.179263 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:27.179264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:27.179265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:27.179269 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:27.179284 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:27.179288 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:27.179340 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.179461 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.179500 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 02:36:27.179699 18784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.174805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33047 (local address 127.17.79.2:32775)
0811 02:36:27.175023 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.175065 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.175550 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.175821 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.175824 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.175832 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:27.176340 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.176344 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.177174 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.177175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.177996 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.177999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.178388 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.178389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.178503 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.179115 (+ 612us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:27.179116 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:27.179145 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:27.179169 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:27.179354 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:27.179359 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:27.179361 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.179416 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.179506 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260811 02:36:27.180852 18782 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33047
I20260811 02:36:27.180959 18782 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:27.181121 18782 heartbeater.cc:511] Master 127.17.79.62:33047 requested a full tablet report, sending...
I20260811 02:36:27.181499 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18554
I20260811 02:36:27.181615 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:36:27.181656 18203 ts_manager.cc:194] Registered new tserver with Master: 2c6302d8c75843bfa2a59498b10f9846 (127.17.79.2:37069)
I20260811 02:36:27.181826 17724 external_mini_cluster.cc:1428] Setting key c51206cc75b0f24d5098423aa6314cfd
I20260811 02:36:27.182121 18203 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.2:32775
I20260811 02:36:27.183020 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33047
--builtin_ntp_servers=127.17.79.20:37353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:27.270067 18785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:27.270344 18785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:27.270370 18785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:27.271495 18785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:27.271530 18785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:27.271555 18785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:36:27.272840 18785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:27.273049 18785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:27.273311 18785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:27.278813 18799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:27.278815 18796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:27.278860 18794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:27.279081 18785 server_base.cc:1034] running on GCE node
I20260811 02:36:27.279326 18785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:27.279593 18785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:27.280766 18785 hybrid_clock.cc:648] HybridClock initialized: now 1786415787280759 us; error 39 us; skew 500 ppm
I20260811 02:36:27.282842 18785 webserver.cc:460] Webserver started at http://127.17.79.3:46529/ using document root <none> and password file <none>
I20260811 02:36:27.283118 18785 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:27.283195 18785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:27.283360 18785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:27.284612 18785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "bc6c267815744764857d847736f3c324"
format_stamp: "Formatted at 2026-08-11 02:36:27 on dist-test-slave-7nm7"
server_key: "f0f4130763c39fb9f2db7141a7ab3cbd"
server_key_iv: "7e3c843f9f8057e72ff3744e0e8723d0"
server_key_version: "encryptionkey@0"
I20260811 02:36:27.285024 18785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "bc6c267815744764857d847736f3c324"
format_stamp: "Formatted at 2026-08-11 02:36:27 on dist-test-slave-7nm7"
server_key: "f0f4130763c39fb9f2db7141a7ab3cbd"
server_key_iv: "7e3c843f9f8057e72ff3744e0e8723d0"
server_key_version: "encryptionkey@0"
I20260811 02:36:27.286482 18785 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260811 02:36:27.287206 18809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:27.287400 18785 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:36:27.287510 18785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "bc6c267815744764857d847736f3c324"
format_stamp: "Formatted at 2026-08-11 02:36:27 on dist-test-slave-7nm7"
server_key: "f0f4130763c39fb9f2db7141a7ab3cbd"
server_key_iv: "7e3c843f9f8057e72ff3744e0e8723d0"
server_key_version: "encryptionkey@0"
I20260811 02:36:27.287585 18785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:27.306097 18785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:27.306504 18785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:27.306658 18785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:27.306924 18785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:27.307277 18785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:27.307335 18785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:27.307381 18785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:27.307410 18785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:27.313768 18785 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:36673
I20260811 02:36:27.313809 18995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:36673 every 8 connection(s)
I20260811 02:36:27.314395 18785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:36:27.319482 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 18785
I20260811 02:36:27.319653 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:36:27.319885 17724 external_mini_cluster.cc:1428] Setting key dade392d49e9b593d8f15b6b8d811697
I20260811 02:36:27.320631 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.315234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:40695 (local address 127.17.79.62:33047)
0811 02:36:27.315306 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.315309 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.315551 (+ 242us) server_negotiation.cc:407] Connection header received
0811 02:36:27.316029 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.316031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.316040 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.316092 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:27.316775 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.317263 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.318388 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.318575 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.318634 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.320104 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:27.320106 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:27.320107 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:27.320116 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:27.320143 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:27.320148 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:27.320222 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.320506 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.320542 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:36:27.320904 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.315227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33047 (local address 127.17.79.3:40695)
0811 02:36:27.315432 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.315467 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.315949 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.316151 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.316155 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.316163 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:27.316693 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.316698 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.317383 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.317385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.318292 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.318295 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.318677 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.318678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.318799 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.319809 (+ 1010us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:27.319810 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:27.319869 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:27.319906 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:27.320227 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:27.320235 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:27.320241 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.320506 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.320634 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":107,"threads_started":1}
I20260811 02:36:27.321451 18996 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33047
I20260811 02:36:27.321581 18996 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:27.321779 18996 heartbeater.cc:511] Master 127.17.79.62:33047 requested a full tablet report, sending...
I20260811 02:36:27.322214 18201 ts_manager.cc:194] Registered new tserver with Master: bc6c267815744764857d847736f3c324 (127.17.79.3:36673)
I20260811 02:36:27.322755 18201 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.3:40695
I20260811 02:36:27.332738 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:36:27.338063 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.334446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.17.79.62:33047)
0811 02:36:27.334536 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.334538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.334673 (+ 135us) server_negotiation.cc:407] Connection header received
0811 02:36:27.334702 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.334703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.334714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.334770 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:27.334925 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.335433 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.336527 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.336763 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.336865 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.337753 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:27.337755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:27.337755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:27.337761 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:27.337782 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:27.337787 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:27.337891 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.337981 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.337996 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 02:36:27.340746 18201 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:36:27.342633 18201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:36:27.349462 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.345558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:36483 (local address 127.0.0.1:50824)
0811 02:36:27.345690 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.345702 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.345750 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.346052 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.346053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.346056 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:27.346109 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.346112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.347137 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.347138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.348400 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.348403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.349153 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.349154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.349229 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.349244 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.349324 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.349381 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":3,"thread_start_us":81,"threads_started":1}
I20260811 02:36:27.349472 19026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.345677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50824 (local address 127.17.79.1:36483)
0811 02:36:27.345883 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.345887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.345897 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:36:27.345933 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.345935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.345950 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.346042 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:27.346203 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.347044 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.348499 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.349063 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.349153 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.349262 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.349337 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.349381 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":97,"threads_started":1}
I20260811 02:36:27.349597 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.345355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:36673 (local address 127.0.0.1:48048)
0811 02:36:27.345484 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.345495 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.345537 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.346153 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.346154 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.346157 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:27.346199 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.346201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.347556 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.347557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.348401 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.348403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.349355 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.349356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.349426 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.349431 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.349460 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.349503 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":1,"thread_start_us":95,"threads_started":1}
I20260811 02:36:27.349606 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.345267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:37069 (local address 127.0.0.1:38830)
0811 02:36:27.345381 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.345420 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.345490 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.345888 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.345891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.345893 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:27.345985 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.345987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.347513 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.347514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.348565 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.348567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.349428 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.349429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.349484 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.349487 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.349515 (+ 28us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.349543 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":68,"threads_started":1}
I20260811 02:36:27.349959 19021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.345387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38830 (local address 127.17.79.2:37069)
0811 02:36:27.345695 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.345700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.345723 (+ 23us) server_negotiation.cc:407] Connection header received
0811 02:36:27.345767 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.345769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.345786 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.345882 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:27.346214 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.347417 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.348650 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.349342 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.349648 (+ 306us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.349763 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.349797 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.349849 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":84,"threads_started":1}
I20260811 02:36:27.350294 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.345779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48048 (local address 127.17.79.3:36673)
0811 02:36:27.345967 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.345971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.345979 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:36:27.346047 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.346049 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.346063 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.346143 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:27.346376 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.347450 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.348500 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.349243 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.349963 (+ 720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.350123 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.350147 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.350182 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260811 02:36:27.350366 18440 tablet_service.cc:1467] Processing CreateTablet for tablet 7149eba5951a42f38357b5d5ba7207bb (DEFAULT_TABLE table=test-table [id=2477f5fc54724d5cb40ca516a69f691c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:27.350793 18440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7149eba5951a42f38357b5d5ba7207bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:27.350704 18668 tablet_service.cc:1467] Processing CreateTablet for tablet 7149eba5951a42f38357b5d5ba7207bb (DEFAULT_TABLE table=test-table [id=2477f5fc54724d5cb40ca516a69f691c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:27.351044 18668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7149eba5951a42f38357b5d5ba7207bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:27.354434 19031 tablet_bootstrap.cc:492] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: Bootstrap starting.
I20260811 02:36:27.354434 19029 tablet_bootstrap.cc:492] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Bootstrap starting.
I20260811 02:36:27.355228 19031 tablet_bootstrap.cc:654] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:27.355228 19029 tablet_bootstrap.cc:654] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:27.355177 18894 tablet_service.cc:1467] Processing CreateTablet for tablet 7149eba5951a42f38357b5d5ba7207bb (DEFAULT_TABLE table=test-table [id=2477f5fc54724d5cb40ca516a69f691c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:27.355538 18894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7149eba5951a42f38357b5d5ba7207bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:27.355589 19029 log.cc:824] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:27.355589 19031 log.cc:824] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:27.356524 19029 tablet_bootstrap.cc:492] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: No bootstrap required, opened a new log
I20260811 02:36:27.356606 19031 tablet_bootstrap.cc:492] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: No bootstrap required, opened a new log
I20260811 02:36:27.356600 19029 ts_tablet_manager.cc:1397] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:27.356679 19031 ts_tablet_manager.cc:1397] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:27.359174 19035 tablet_bootstrap.cc:492] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Bootstrap starting.
I20260811 02:36:27.359380 19031 raft_consensus.cc:348] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.359380 19029 raft_consensus.cc:348] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.359557 19031 raft_consensus.cc:374] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:27.359557 19029 raft_consensus.cc:374] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:27.359596 19031 raft_consensus.cc:729] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47880aaf875c4b18a3eb5ad0bbb04f04, State: Initialized, Role: FOLLOWER
I20260811 02:36:27.359596 19029 raft_consensus.cc:729] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c6302d8c75843bfa2a59498b10f9846, State: Initialized, Role: FOLLOWER
I20260811 02:36:27.359750 19031 consensus_queue.cc:260] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.359750 19029 consensus_queue.cc:260] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.359946 19035 tablet_bootstrap.cc:654] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:27.360021 19031 ts_tablet_manager.cc:1428] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 02:36:27.360021 19029 ts_tablet_manager.cc:1428] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 02:36:27.360154 18782 heartbeater.cc:503] Master 127.17.79.62:33047 was elected leader, sending a full tablet report...
I20260811 02:36:27.360164 18550 heartbeater.cc:503] Master 127.17.79.62:33047 was elected leader, sending a full tablet report...
I20260811 02:36:27.360325 19035 log.cc:824] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:27.361493 19035 tablet_bootstrap.cc:492] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: No bootstrap required, opened a new log
I20260811 02:36:27.361574 19035 ts_tablet_manager.cc:1397] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:27.363490 19035 raft_consensus.cc:348] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.363636 19035 raft_consensus.cc:374] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:27.363658 19035 raft_consensus.cc:729] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6c267815744764857d847736f3c324, State: Initialized, Role: FOLLOWER
I20260811 02:36:27.363794 19035 consensus_queue.cc:260] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.364068 19035 ts_tablet_manager.cc:1428] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 02:36:27.364285 18996 heartbeater.cc:503] Master 127.17.79.62:33047 was elected leader, sending a full tablet report...
W20260811 02:36:27.424510 18783 tablet.cc:2369] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:27.498087 19037 raft_consensus.cc:482] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:27.498378 19037 raft_consensus.cc:504] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.499106 19037 leader_election.cc:288] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc6c267815744764857d847736f3c324 (127.17.79.3:36673), 47880aaf875c4b18a3eb5ad0bbb04f04 (127.17.79.1:36483)
I20260811 02:36:27.502727 19028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.499560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:38101 (local address 127.17.79.3:36673)
0811 02:36:27.499631 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.499634 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.499647 (+ 13us) server_negotiation.cc:407] Connection header received
0811 02:36:27.499714 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.499715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.499729 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.499844 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:27.500065 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.500562 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.501825 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.502225 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.502384 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.502398 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.502626 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.502670 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 02:36:27.502727 18784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.499274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:36673 (local address 127.17.79.2:38101)
0811 02:36:27.499339 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.499352 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.499407 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.499877 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.499878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.499880 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:27.499965 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.499967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.500674 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.500675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.501696 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.501698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.502417 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.502419 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.502507 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.502511 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.502581 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.502625 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:36:27.503255 18925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7149eba5951a42f38357b5d5ba7207bb" candidate_uuid: "2c6302d8c75843bfa2a59498b10f9846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6c267815744764857d847736f3c324" is_pre_election: true
I20260811 02:36:27.503446 18925 raft_consensus.cc:2454] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c6302d8c75843bfa2a59498b10f9846 in term 0.
I20260811 02:36:27.503803 18588 leader_election.cc:302] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c6302d8c75843bfa2a59498b10f9846, bc6c267815744764857d847736f3c324; no voters:
I20260811 02:36:27.503962 19037 raft_consensus.cc:2781] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:36:27.504032 19037 raft_consensus.cc:482] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:36:27.504030 19026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.499560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:47739 (local address 127.17.79.1:36483)
0811 02:36:27.499631 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.499634 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.499721 (+ 87us) server_negotiation.cc:407] Connection header received
0811 02:36:27.499813 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.499815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.499829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.500053 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:27.500881 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.501536 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.502932 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.503544 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.503713 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.503728 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.503905 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.503956 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 02:36:27.504041 19042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.499403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:36483 (local address 127.17.79.2:47739)
0811 02:36:27.499625 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.499640 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:27.499733 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:27.500677 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:27.500678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:27.500680 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:27.500749 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.500750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.501656 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.501657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.502804 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:27.502807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.503735 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.503736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:27.503809 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.503813 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:27.503884 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 02:36:27.503930 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":173,"threads_started":1}
I20260811 02:36:27.504083 19037 raft_consensus.cc:3037] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 0 FOLLOWER]: Advancing to term 1
W20260811 02:36:27.504814 18552 tablet.cc:2369] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:27.505270 19037 raft_consensus.cc:504] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.505493 19037 leader_election.cc:288] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [CANDIDATE]: Term 1 election: Requested vote from peers bc6c267815744764857d847736f3c324 (127.17.79.3:36673), 47880aaf875c4b18a3eb5ad0bbb04f04 (127.17.79.1:36483)
I20260811 02:36:27.505828 18925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7149eba5951a42f38357b5d5ba7207bb" candidate_uuid: "2c6302d8c75843bfa2a59498b10f9846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6c267815744764857d847736f3c324"
I20260811 02:36:27.505954 18925 raft_consensus.cc:3037] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:27.506132 18472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7149eba5951a42f38357b5d5ba7207bb" candidate_uuid: "2c6302d8c75843bfa2a59498b10f9846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" is_pre_election: true
I20260811 02:36:27.506121 18471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7149eba5951a42f38357b5d5ba7207bb" candidate_uuid: "2c6302d8c75843bfa2a59498b10f9846" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04"
I20260811 02:36:27.506343 18472 raft_consensus.cc:2454] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c6302d8c75843bfa2a59498b10f9846 in term 0.
I20260811 02:36:27.506959 18925 raft_consensus.cc:2454] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c6302d8c75843bfa2a59498b10f9846 in term 1.
I20260811 02:36:27.507126 18588 leader_election.cc:302] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c6302d8c75843bfa2a59498b10f9846, bc6c267815744764857d847736f3c324; no voters: 47880aaf875c4b18a3eb5ad0bbb04f04
I20260811 02:36:27.507237 19037 raft_consensus.cc:2781] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:27.507404 19037 raft_consensus.cc:686] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 1 LEADER]: Becoming Leader. State: Replica: 2c6302d8c75843bfa2a59498b10f9846, State: Running, Role: LEADER
I20260811 02:36:27.507503 19037 consensus_queue.cc:237] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } }
I20260811 02:36:27.508407 18203 catalog_manager.cc:5495] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c6302d8c75843bfa2a59498b10f9846 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "2c6302d8c75843bfa2a59498b10f9846" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c6302d8c75843bfa2a59498b10f9846" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 37069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 } health_report { overall_health: UNKNOWN } } }
I20260811 02:36:27.534020 19021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.531550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38834 (local address 127.17.79.2:37069)
0811 02:36:27.531651 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:27.531653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:27.531663 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:36:27.531703 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:27.531704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:27.531728 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:27.531802 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:36:27.531925 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.532439 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.533230 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:27.533440 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:27.533508 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:27.533658 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:36:27.533749 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:36:27.533820 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:27.533869 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 02:36:27.533878 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 02:36:27.536593 18471 raft_consensus.cc:3037] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:27.536798 18925 raft_consensus.cc:1261] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 1 FOLLOWER]: Refusing update from remote peer 2c6302d8c75843bfa2a59498b10f9846: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:27.537866 18471 raft_consensus.cc:1261] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 1 FOLLOWER]: Refusing update from remote peer 2c6302d8c75843bfa2a59498b10f9846: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:27.538074 19048 consensus_queue.cc:1035] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc6c267815744764857d847736f3c324" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:27.538286 19037 consensus_queue.cc:1035] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47880aaf875c4b18a3eb5ad0bbb04f04" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 36483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:27.541203 19059 mvcc.cc:205] Tried to move back new op lower bound from 7317159065745752064 to 7317159065631354880. Current Snapshot: MvccSnapshot[applied={T|T < 7317159065745752064}]
I20260811 02:36:27.543247 18201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:27.543351 18201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:27.544191 18201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a303e7dc6a134e18bfbc54aa0bf87fc2: Sending DeleteTablet for 3 replicas of tablet 7149eba5951a42f38357b5d5ba7207bb
I20260811 02:36:27.544579 18440 tablet_service.cc:1514] Processing DeleteTablet for tablet 7149eba5951a42f38357b5d5ba7207bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:27 UTC) from {username='slave'} at 127.0.0.1:50824
I20260811 02:36:27.544579 18668 tablet_service.cc:1514] Processing DeleteTablet for tablet 7149eba5951a42f38357b5d5ba7207bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:27 UTC) from {username='slave'} at 127.0.0.1:38830
I20260811 02:36:27.544839 18894 tablet_service.cc:1514] Processing DeleteTablet for tablet 7149eba5951a42f38357b5d5ba7207bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:27 UTC) from {username='slave'} at 127.0.0.1:48048
I20260811 02:36:27.544850 19077 tablet_replica.cc:330] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: stopping tablet replica
I20260811 02:36:27.544953 19077 raft_consensus.cc:2229] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:27.545044 19078 tablet_replica.cc:330] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: stopping tablet replica
I20260811 02:36:27.545064 19077 raft_consensus.cc:2258] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:27.545132 19078 raft_consensus.cc:2229] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:27.545318 19078 raft_consensus.cc:2258] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:27.545375 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18328
I20260811 02:36:27.545550 19077 ts_tablet_manager.cc:1905] T 7149eba5951a42f38357b5d5ba7207bb P 47880aaf875c4b18a3eb5ad0bbb04f04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:27.545747 19078 ts_tablet_manager.cc:1905] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:27.547921 19078 ts_tablet_manager.cc:1918] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:27.548002 19078 log.cc:1196] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/7149eba5951a42f38357b5d5ba7207bb
I20260811 02:36:27.548305 19078 ts_tablet_manager.cc:1939] T 7149eba5951a42f38357b5d5ba7207bb P bc6c267815744764857d847736f3c324: Deleting consensus metadata
I20260811 02:36:27.548821 18175 catalog_manager.cc:4841] TS bc6c267815744764857d847736f3c324 (127.17.79.3:36673): tablet 7149eba5951a42f38357b5d5ba7207bb (table test-table [id=2477f5fc54724d5cb40ca516a69f691c]) successfully deleted
I20260811 02:36:27.550211 19075 tablet_replica.cc:330] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: stopping tablet replica
I20260811 02:36:27.550360 19075 raft_consensus.cc:2229] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:36:27.550474 19075 raft_consensus.cc:2258] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:27.552965 19075 ts_tablet_manager.cc:1905] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:27.554557 19075 ts_tablet_manager.cc:1918] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:27.554653 19075 log.cc:1196] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/7149eba5951a42f38357b5d5ba7207bb
I20260811 02:36:27.554908 19075 ts_tablet_manager.cc:1939] T 7149eba5951a42f38357b5d5ba7207bb P 2c6302d8c75843bfa2a59498b10f9846: Deleting consensus metadata
I20260811 02:36:27.555670 18171 catalog_manager.cc:4841] TS 2c6302d8c75843bfa2a59498b10f9846 (127.17.79.2:37069): tablet 7149eba5951a42f38357b5d5ba7207bb (table test-table [id=2477f5fc54724d5cb40ca516a69f691c]) successfully deleted
W20260811 02:36:27.559417 18175 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:36483 (error 108)
I20260811 02:36:27.560091 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:27.559917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:36483 (local address 127.0.0.1:50836)
0811 02:36:27.559976 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:27.560020 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:36483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 02:36:27.560139 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18554
W20260811 02:36:27.572383 18175 catalog_manager.cc:4584] TS 47880aaf875c4b18a3eb5ad0bbb04f04 (127.17.79.1:36483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7149eba5951a42f38357b5d5ba7207bb: Network error: Client connection negotiation failed: client connection to 127.17.79.1:36483: connect: Connection refused (error 111)
I20260811 02:36:27.576917 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18785
I20260811 02:36:27.586921 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 18140
2026-08-11T02:36:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (922 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:27 dist-test-slave-7nm7 krb5kdc[19084](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:27 dist-test-slave-7nm7 krb5kdc[19084](info): set up 2 sockets
Aug 11 02:36:27 dist-test-slave-7nm7 krb5kdc[19084](info): commencing operation
krb5kdc: starting...
W20260811 02:36:28.892482 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:28 dist-test-slave-7nm7 krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:29.023151 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36991
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:36991
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:29.110378 19108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:29.110594 19108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:29.110617 19108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:29.111773 19108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:29.111851 19108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:29.111881 19108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:29.111903 19108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:29.111933 19108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:29.113474 19108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:36991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:29.113775 19108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:29.114022 19108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:29.119257 19121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:29.119273 19122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:29.119275 19126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:29.119626 19108 server_base.cc:1034] running on GCE node
I20260811 02:36:29.119915 19108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:29.120250 19108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:29.121577 19108 hybrid_clock.cc:648] HybridClock initialized: now 1786415789121561 us; error 28 us; skew 500 ppm
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415789, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:29.124432 19108 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:29.124929 19108 webserver.cc:460] Webserver started at http://127.17.79.62:44501/ using document root <none> and password file <none>
I20260811 02:36:29.125121 19108 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:29.125164 19108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:29.125258 19108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:29.126415 19108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "e116fce814614d7f83f6d43658bc6814"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "c043cd2e760fc5ad9d0e14a66f9799ab"
server_key_iv: "3258ddf083c5f72add358a81aa2850b6"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.126757 19108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "e116fce814614d7f83f6d43658bc6814"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "c043cd2e760fc5ad9d0e14a66f9799ab"
server_key_iv: "3258ddf083c5f72add358a81aa2850b6"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.128113 19108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:29.128918 19141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.129155 19108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:29.129254 19108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "e116fce814614d7f83f6d43658bc6814"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "c043cd2e760fc5ad9d0e14a66f9799ab"
server_key_iv: "3258ddf083c5f72add358a81aa2850b6"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.129312 19108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:29.138806 19108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:29.140827 19108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:29.140940 19108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:29.145010 19108 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:36991
I20260811 02:36:29.145092 19247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:36991 every 8 connection(s)
I20260811 02:36:29.145437 19108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:29.146417 19249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:29.148720 19249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814: Bootstrap starting.
I20260811 02:36:29.149312 19249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:29.149583 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19108
I20260811 02:36:29.149685 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:29.149680 19249 log.cc:824] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:29.149891 17724 external_mini_cluster.cc:1428] Setting key ea69e7045c25ef87b7243e8c45bdb381
I20260811 02:36:29.150590 19249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814: No bootstrap required, opened a new log
I20260811 02:36:29.152622 19249 raft_consensus.cc:348] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e116fce814614d7f83f6d43658bc6814" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36991 } }
I20260811 02:36:29.152789 19249 raft_consensus.cc:374] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:29.152827 19249 raft_consensus.cc:729] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e116fce814614d7f83f6d43658bc6814, State: Initialized, Role: FOLLOWER
I20260811 02:36:29.152967 19249 consensus_queue.cc:260] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e116fce814614d7f83f6d43658bc6814" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36991 } }
I20260811 02:36:29.153056 19249 raft_consensus.cc:388] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:29.153111 19249 raft_consensus.cc:482] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:29.153169 19249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:29.153873 19249 raft_consensus.cc:504] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e116fce814614d7f83f6d43658bc6814" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36991 } }
I20260811 02:36:29.153980 19249 leader_election.cc:302] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e116fce814614d7f83f6d43658bc6814; no voters:
I20260811 02:36:29.154151 19249 leader_election.cc:288] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:29.154232 19259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:29.154400 19249 sys_catalog.cc:564] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:29.154407 19259 raft_consensus.cc:686] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [term 1 LEADER]: Becoming Leader. State: Replica: e116fce814614d7f83f6d43658bc6814, State: Running, Role: LEADER
I20260811 02:36:29.154524 19259 consensus_queue.cc:237] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e116fce814614d7f83f6d43658bc6814" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36991 } }
I20260811 02:36:29.154812 19259 sys_catalog.cc:455] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e116fce814614d7f83f6d43658bc6814. Latest consensus state: current_term: 1 leader_uuid: "e116fce814614d7f83f6d43658bc6814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e116fce814614d7f83f6d43658bc6814" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36991 } } }
I20260811 02:36:29.154919 19259 sys_catalog.cc:458] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:29.154824 19262 sys_catalog.cc:455] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e116fce814614d7f83f6d43658bc6814" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e116fce814614d7f83f6d43658bc6814" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36991 } } }
I20260811 02:36:29.155019 19262 sys_catalog.cc:458] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:29.155133 19271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:29.155671 19271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:29.157871 19271 catalog_manager.cc:1347] Generated new cluster ID: 643b777332a9421ea30750c50bfc5d30
I20260811 02:36:29.157928 19271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:29.163214 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.150508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49146 (local address 127.17.79.62:36991)
0811 02:36:29.150734 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.150744 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.150778 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:36:29.151842 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.151852 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.151915 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.152071 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:29.152789 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.154555 (+ 1766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.155730 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.156159 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.156624 (+ 465us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.159309 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:29.159313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:29.159313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:29.159325 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:29.161293 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.161712 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.161715 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.161716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.161824 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.162044 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.162045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.162045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.162371 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:29.162526 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.162734 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.162866 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":99,"threads_started":1}
I20260811 02:36:29.164813 19271 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:29.165290 19271 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:29.171892 19271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814: Generated new TSK 0
I20260811 02:36:29.172091 19271 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.79.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
Entry for principal kudu/127.17.79.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab.
I20260811 02:36:29.201385 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36991
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:29.288805 19291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:29.289022 19291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:29.289047 19291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:29.290313 19291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:29.290357 19291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:29.290386 19291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:36:29.291885 19291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.1.keytab
--principal=kudu/127.17.79.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:29.292140 19291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:29.292398 19291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:29.299063 19305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:29.299064 19302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:29.299156 19291 server_base.cc:1034] running on GCE node
W20260811 02:36:29.299115 19300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:29.299979 19291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:29.300452 19291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:29.301667 19291 hybrid_clock.cc:648] HybridClock initialized: now 1786415789301624 us; error 64 us; skew 500 ppm
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415789, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:29.304518 19291 init.cc:377] Logged in from keytab as kudu/127.17.79.1@KRBTEST.COM (short username kudu)
I20260811 02:36:29.305047 19291 webserver.cc:460] Webserver started at http://127.17.79.1:39327/ using document root <none> and password file <none>
I20260811 02:36:29.305292 19291 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:29.305346 19291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:29.305480 19291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:29.306645 19291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "eba1e32270d1463891ab4a2a4de03ade"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "93913e62a06710755314283f68019e4a"
server_key_iv: "64728afe4a5c40974e8deb11c55ce9c5"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.307010 19291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "eba1e32270d1463891ab4a2a4de03ade"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "93913e62a06710755314283f68019e4a"
server_key_iv: "64728afe4a5c40974e8deb11c55ce9c5"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.308517 19291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:29.309446 19317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.309691 19291 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:29.309808 19291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "eba1e32270d1463891ab4a2a4de03ade"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "93913e62a06710755314283f68019e4a"
server_key_iv: "64728afe4a5c40974e8deb11c55ce9c5"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.309895 19291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:29.319703 19291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:29.321866 19291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:29.322039 19291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:29.322389 19291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:29.322731 19291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:29.322790 19291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.322831 19291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:29.322860 19291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.329309 19291 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:39861
I20260811 02:36:29.329358 19523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:39861 every 8 connection(s)
I20260811 02:36:29.329692 19291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415789, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.1@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:29.337337 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19291
I20260811 02:36:29.337479 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:36:29.337728 17724 external_mini_cluster.cc:1428] Setting key b9bb14488a4d3a5f793e0215422bb460
I20260811 02:36:29.340724 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.330455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:40919 (local address 127.17.79.62:36991)
0811 02:36:29.330539 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.330541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.330703 (+ 162us) server_negotiation.cc:407] Connection header received
0811 02:36:29.331439 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.331441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.331454 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.331531 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:29.332607 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.333151 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.334220 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.334470 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.334549 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.337453 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:29.337456 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:29.337456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:29.337466 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:29.339074 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.339618 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.339619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.339620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.339671 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.339957 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.339958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.339958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.340058 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:29.340108 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.340477 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.340584 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 02:36:29.340847 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.330409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36991 (local address 127.17.79.1:40919)
0811 02:36:29.330591 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.330628 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.331312 (+ 684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.331636 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.331640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.332291 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:29.332489 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.332493 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.333295 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.333297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.334110 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.334112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.334557 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.334558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.334698 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.335423 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:29.335439 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:29.337333 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:29.339160 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:29.339168 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:29.339170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:29.339535 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:29.339739 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:29.339740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:29.339741 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:29.339890 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:29.340121 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:29.340127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:29.340310 (+ 183us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.340438 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.340633 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260811 02:36:29.341341 19524 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36991
I20260811 02:36:29.341451 19524 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:29.341627 19524 heartbeater.cc:511] Master 127.17.79.62:36991 requested a full tablet report, sending...
I20260811 02:36:29.342190 19177 ts_manager.cc:194] Registered new tserver with Master: eba1e32270d1463891ab4a2a4de03ade (127.17.79.1:39861)
I20260811 02:36:29.342809 19177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.1@KRBTEST.COM'} at 127.17.79.1:40919
WARNING: no policy specified for kudu/127.17.79.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
Entry for principal kudu/127.17.79.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab.
I20260811 02:36:29.364567 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36991
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:29.448087 19534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:29.448295 19534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:29.448319 19534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:29.449447 19534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:29.449489 19534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:29.449517 19534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:36:29.450994 19534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.2.keytab
--principal=kudu/127.17.79.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:29.451234 19534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:29.451472 19534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:29.456653 19545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:29.456624 19542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:29.456631 19541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:29.456827 19534 server_base.cc:1034] running on GCE node
I20260811 02:36:29.457072 19534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:29.457346 19534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:29.458513 19534 hybrid_clock.cc:648] HybridClock initialized: now 1786415789458492 us; error 35 us; skew 500 ppm
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415789, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:29.461064 19534 init.cc:377] Logged in from keytab as kudu/127.17.79.2@KRBTEST.COM (short username kudu)
I20260811 02:36:29.461577 19534 webserver.cc:460] Webserver started at http://127.17.79.2:44083/ using document root <none> and password file <none>
I20260811 02:36:29.461827 19534 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:29.461874 19534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:29.462042 19534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:29.463152 19534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "e73c78c7331bafaea172a7605bd49184"
server_key_iv: "6100d290f122c999a4a9cbbc184ea669"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.463506 19534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "e73c78c7331bafaea172a7605bd49184"
server_key_iv: "6100d290f122c999a4a9cbbc184ea669"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.464865 19534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:29.465721 19557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.465946 19534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:29.466043 19534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "e73c78c7331bafaea172a7605bd49184"
server_key_iv: "6100d290f122c999a4a9cbbc184ea669"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.466126 19534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:29.485138 19534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:29.487339 19534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:29.487493 19534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:29.487769 19534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:29.488106 19534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:29.488142 19534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.488164 19534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:29.488211 19534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.494045 19534 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:35025
I20260811 02:36:29.494127 19755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:35025 every 8 connection(s)
I20260811 02:36:29.494459 19534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:36:29.500139 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19534
I20260811 02:36:29.500286 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:36:29.500502 17724 external_mini_cluster.cc:1428] Setting key cd1652ed193185848b588d4a71febbae
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415789, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.2@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:29.505141 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.495233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:47321 (local address 127.17.79.62:36991)
0811 02:36:29.495322 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.495324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.495484 (+ 160us) server_negotiation.cc:407] Connection header received
0811 02:36:29.495986 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.495988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.496018 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.496091 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:29.497123 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.497636 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.498754 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.498940 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.499000 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.501569 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:29.501570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:29.501571 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:29.501578 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:29.503513 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.503995 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.503996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.503997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.504059 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.504358 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.504359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.504360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.504484 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:29.504562 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.504869 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.505033 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 02:36:29.505378 19759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.495181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36991 (local address 127.17.79.2:47321)
0811 02:36:29.495361 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.495400 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.495866 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.496204 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.496208 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.496813 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:29.497005 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.497009 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.497724 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.497725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.498664 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.498666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.499018 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.499019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.499116 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.499618 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:29.499628 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:29.501446 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:29.503643 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:29.503652 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:29.503654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:29.503894 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:29.504147 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:29.504148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:29.504148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:29.504263 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:29.504553 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:29.504561 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:29.504716 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.504846 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.505131 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":102,"threads_started":1}
I20260811 02:36:29.506058 19756 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36991
I20260811 02:36:29.506179 19756 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:29.506388 19756 heartbeater.cc:511] Master 127.17.79.62:36991 requested a full tablet report, sending...
I20260811 02:36:29.506807 19177 ts_manager.cc:194] Registered new tserver with Master: 46b93f7cb3fe4ca7b7f0bc057db7cadd (127.17.79.2:35025)
I20260811 02:36:29.507251 19177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.2@KRBTEST.COM'} at 127.17.79.2:47321
WARNING: no policy specified for kudu/127.17.79.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
Entry for principal kudu/127.17.79.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab.
I20260811 02:36:29.531144 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36991
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:29.621001 19767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:29.621243 19767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:29.621285 19767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:29.622476 19767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:29.622547 19767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:29.622596 19767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:36:29.624068 19767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.3.keytab
--principal=kudu/127.17.79.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:36991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:29.624332 19767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:29.624564 19767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:29.629737 19787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:29.629737 19784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:29.629784 19778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:29.629909 19767 server_base.cc:1034] running on GCE node
I20260811 02:36:29.630089 19767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:29.630354 19767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:29.631501 19767 hybrid_clock.cc:648] HybridClock initialized: now 1786415789631488 us; error 32 us; skew 500 ppm
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415789, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:29.634440 19767 init.cc:377] Logged in from keytab as kudu/127.17.79.3@KRBTEST.COM (short username kudu)
I20260811 02:36:29.634904 19767 webserver.cc:460] Webserver started at http://127.17.79.3:34263/ using document root <none> and password file <none>
I20260811 02:36:29.635128 19767 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:29.635175 19767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:29.635313 19767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:29.636354 19767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "62d74e881b7e2af994181f48e18b0ba7"
server_key_iv: "7ad81ee5643349e3321ebcfdc21da2b9"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.636718 19767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "62d74e881b7e2af994181f48e18b0ba7"
server_key_iv: "7ad81ee5643349e3321ebcfdc21da2b9"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.638042 19767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:29.638839 19796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.639031 19767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:36:29.639132 19767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9"
format_stamp: "Formatted at 2026-08-11 02:36:29 on dist-test-slave-7nm7"
server_key: "62d74e881b7e2af994181f48e18b0ba7"
server_key_iv: "7ad81ee5643349e3321ebcfdc21da2b9"
server_key_version: "encryptionkey@0"
I20260811 02:36:29.639216 19767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:29.648836 19767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:29.651397 19767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:29.651561 19767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:29.651808 19767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:29.652118 19767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:29.652179 19767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.652223 19767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:29.652249 19767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:29.659096 19767 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:35667
I20260811 02:36:29.659147 19993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:35667 every 8 connection(s)
I20260811 02:36:29.659467 19767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
Aug 11 02:36:29 dist-test-slave-7nm7 krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415789, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.3@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:29.667781 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 19767
I20260811 02:36:29.667925 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:36:29.668112 17724 external_mini_cluster.cc:1428] Setting key 48fd64a2315400d3be323562cba1218d
I20260811 02:36:29.669088 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.660124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:46911 (local address 127.17.79.62:36991)
0811 02:36:29.660191 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.660193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.660378 (+ 185us) server_negotiation.cc:407] Connection header received
0811 02:36:29.660911 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.660912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.660924 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.660978 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:29.661925 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.662488 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.663611 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.663803 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.663884 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.666048 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:29.666050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:29.666051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:29.666059 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:29.667323 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.667757 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.667759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.667760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.667821 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.668117 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.668118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.668118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.668283 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:29.668358 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.668798 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.668940 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:36:29.669310 19998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.660107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:36991 (local address 127.17.79.3:46911)
0811 02:36:29.660260 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.660295 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.660811 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.661058 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.661062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.661629 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:29.661819 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.661823 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.662581 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.662582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.663462 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.663465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.663891 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.663892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.664015 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.664520 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:36:29.664529 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:29.665954 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:29.667418 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:29.667425 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:29.667427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:29.667670 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:29.667892 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:36:29.667893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:36:29.667893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:36:29.668043 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:36:29.668437 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:29.668443 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:29.668632 (+ 189us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.668761 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.668952 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260811 02:36:29.669757 19994 heartbeater.cc:347] Connected to a master server at 127.17.79.62:36991
I20260811 02:36:29.669858 19994 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:29.670065 19994 heartbeater.cc:511] Master 127.17.79.62:36991 requested a full tablet report, sending...
I20260811 02:36:29.670506 19177 ts_manager.cc:194] Registered new tserver with Master: 20c6338ba3a84de8a9fd4f0aa1c122a9 (127.17.79.3:35667)
I20260811 02:36:29.670854 19177 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.79.3@KRBTEST.COM'} at 127.17.79.3:46911
I20260811 02:36:29.680625 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:36:29.689524 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.682055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49162 (local address 127.17.79.62:36991)
0811 02:36:29.682258 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.682261 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.682364 (+ 103us) server_negotiation.cc:407] Connection header received
0811 02:36:29.682445 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.682446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.682457 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.682528 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:29.683205 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.683712 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.684553 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.684769 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.684847 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.686609 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:29.686611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:29.686611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:29.686619 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:29.688062 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.688636 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.688637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.688638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.688703 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:29.688918 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:29.688918 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:29.688919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:29.689086 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:29.689210 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.689328 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.689417 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153}
I20260811 02:36:29.691418 19177 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49162:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:36:29.693053 19177 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:36:29.699919 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.695689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:35667 (local address 127.0.0.1:52138)
0811 02:36:29.696005 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.696047 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.696119 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.696515 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.696518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.696521 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:29.696598 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.696600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.697607 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.697608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.698781 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.698784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.699574 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.699575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.699670 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.699685 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.699785 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.699842 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":88,"threads_started":1}
I20260811 02:36:29.699935 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.696135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52138 (local address 127.17.79.3:35667)
0811 02:36:29.696314 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.696318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.696329 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:36:29.696373 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.696375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.696394 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.696677 (+ 283us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:29.696764 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.697502 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.698875 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.699483 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.699574 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.699649 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.699803 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.699849 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260811 02:36:29.700332 20024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.695921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39861 (local address 127.0.0.1:59922)
0811 02:36:29.696372 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.696384 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.696446 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.696777 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.696778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.696780 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:29.696819 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.696820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.698079 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.698081 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.699148 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.699150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.700064 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.700066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.700146 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.700151 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.700201 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.700242 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":26,"thread_start_us":100,"threads_started":1}
I20260811 02:36:29.700507 20023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.695809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52118 (local address 127.17.79.2:35025)
0811 02:36:29.696196 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.696201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.696411 (+ 210us) server_negotiation.cc:407] Connection header received
0811 02:36:29.696552 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.696555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.696571 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.696658 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:29.696829 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.697961 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.699157 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.699870 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.699948 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.700004 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.700378 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.700430 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":97,"threads_started":1}
I20260811 02:36:29.700575 20027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.696166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59922 (local address 127.17.79.1:39861)
0811 02:36:29.696610 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.696614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.696621 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:36:29.696680 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.696682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.696696 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.696782 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:29.696879 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.697961 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.699238 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.699924 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.699980 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.700027 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.700447 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.700490 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":104,"threads_started":1}
I20260811 02:36:29.700729 20020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.695692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:35025 (local address 127.0.0.1:52118)
0811 02:36:29.696342 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.696352 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.696440 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.696669 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.696670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.696672 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:29.696733 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.696735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.698099 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.698100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.699051 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.699054 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.700174 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.700175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.700242 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.700245 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.700292 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.700321 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":72,"threads_started":1}
I20260811 02:36:29.700764 19876 tablet_service.cc:1467] Processing CreateTablet for tablet 9345713cdc784a34a63b7059d3f6f94f (DEFAULT_TABLE table=test-table [id=483db88b0e6342bc94b4887f9a43a4a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:29.701177 19876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9345713cdc784a34a63b7059d3f6f94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:29.702886 19401 tablet_service.cc:1467] Processing CreateTablet for tablet 9345713cdc784a34a63b7059d3f6f94f (DEFAULT_TABLE table=test-table [id=483db88b0e6342bc94b4887f9a43a4a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:29.702965 19646 tablet_service.cc:1467] Processing CreateTablet for tablet 9345713cdc784a34a63b7059d3f6f94f (DEFAULT_TABLE table=test-table [id=483db88b0e6342bc94b4887f9a43a4a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:29.703244 19401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9345713cdc784a34a63b7059d3f6f94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:29.703312 19646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9345713cdc784a34a63b7059d3f6f94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:29.704444 20028 tablet_bootstrap.cc:492] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Bootstrap starting.
I20260811 02:36:29.705209 20028 tablet_bootstrap.cc:654] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:29.705823 20028 log.cc:824] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:29.706363 20036 tablet_bootstrap.cc:492] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Bootstrap starting.
I20260811 02:36:29.706678 20028 tablet_bootstrap.cc:492] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: No bootstrap required, opened a new log
I20260811 02:36:29.706743 20028 ts_tablet_manager.cc:1397] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 02:36:29.706897 20038 tablet_bootstrap.cc:492] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade: Bootstrap starting.
I20260811 02:36:29.706992 20036 tablet_bootstrap.cc:654] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:29.707396 20036 log.cc:824] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:29.707515 20038 tablet_bootstrap.cc:654] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:29.708076 20038 log.cc:824] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:29.708590 20036 tablet_bootstrap.cc:492] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: No bootstrap required, opened a new log
I20260811 02:36:29.708665 20036 ts_tablet_manager.cc:1397] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 02:36:29.708812 20028 raft_consensus.cc:348] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.708986 20028 raft_consensus.cc:374] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:29.709024 20028 raft_consensus.cc:729] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c6338ba3a84de8a9fd4f0aa1c122a9, State: Initialized, Role: FOLLOWER
I20260811 02:36:29.709051 20038 tablet_bootstrap.cc:492] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade: No bootstrap required, opened a new log
I20260811 02:36:29.709102 20038 ts_tablet_manager.cc:1397] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:29.709162 20028 consensus_queue.cc:260] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.709445 20028 ts_tablet_manager.cc:1428] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 02:36:29.709489 19994 heartbeater.cc:503] Master 127.17.79.62:36991 was elected leader, sending a full tablet report...
I20260811 02:36:29.710912 20036 raft_consensus.cc:348] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.710944 20038 raft_consensus.cc:348] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.711064 20036 raft_consensus.cc:374] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:29.711086 20036 raft_consensus.cc:729] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46b93f7cb3fe4ca7b7f0bc057db7cadd, State: Initialized, Role: FOLLOWER
I20260811 02:36:29.711090 20038 raft_consensus.cc:374] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:29.711133 20038 raft_consensus.cc:729] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eba1e32270d1463891ab4a2a4de03ade, State: Initialized, Role: FOLLOWER
I20260811 02:36:29.711208 20036 consensus_queue.cc:260] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.711258 20038 consensus_queue.cc:260] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.711558 19756 heartbeater.cc:503] Master 127.17.79.62:36991 was elected leader, sending a full tablet report...
I20260811 02:36:29.711562 20038 ts_tablet_manager.cc:1428] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 02:36:29.711616 19524 heartbeater.cc:503] Master 127.17.79.62:36991 was elected leader, sending a full tablet report...
I20260811 02:36:29.711560 20036 ts_tablet_manager.cc:1428] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
W20260811 02:36:29.745081 19757 tablet.cc:2369] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:29.807943 20043 raft_consensus.cc:482] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:29.808102 20043 raft_consensus.cc:504] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.808593 20043 leader_election.cc:288] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c6338ba3a84de8a9fd4f0aa1c122a9 (127.17.79.3:35667), eba1e32270d1463891ab4a2a4de03ade (127.17.79.1:39861)
I20260811 02:36:29.812143 20027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.809025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:50963 (local address 127.17.79.1:39861)
0811 02:36:29.809112 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.809114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.809122 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:36:29.809149 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.809150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.809161 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.809277 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:29.809490 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.810263 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.811361 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.811744 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.811846 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.811858 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.812031 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.812073 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 02:36:29.812150 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.808927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:39521 (local address 127.17.79.3:35667)
0811 02:36:29.808985 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.808988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.809192 (+ 204us) server_negotiation.cc:407] Connection header received
0811 02:36:29.809248 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.809249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.809264 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.809318 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:29.809493 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.810287 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.811377 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.811778 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.811869 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.811880 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.812043 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.812081 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 02:36:29.812168 20046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.808833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:35667 (local address 127.17.79.2:39521)
0811 02:36:29.809115 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.809123 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.809193 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.809351 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.809352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.809354 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:29.809414 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.809415 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.810378 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.810379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.811257 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.811260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.811871 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.811872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.811951 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.811955 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.812034 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.812075 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":119,"thread_start_us":132,"threads_started":1}
I20260811 02:36:29.812176 19759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.808824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39861 (local address 127.17.79.2:50963)
0811 02:36:29.808884 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.808897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:29.808952 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:29.809294 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:29.809295 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:29.809297 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:29.809380 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.809382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.810370 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.810371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.811253 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:29.811256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.811846 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.811847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:29.811936 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.811940 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:29.812014 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 02:36:29.812061 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":20}
I20260811 02:36:29.812618 19914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9345713cdc784a34a63b7059d3f6f94f" candidate_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" is_pre_election: true
I20260811 02:36:29.812620 19441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9345713cdc784a34a63b7059d3f6f94f" candidate_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eba1e32270d1463891ab4a2a4de03ade" is_pre_election: true
I20260811 02:36:29.812779 19441 raft_consensus.cc:2454] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93f7cb3fe4ca7b7f0bc057db7cadd in term 0.
I20260811 02:36:29.812781 19914 raft_consensus.cc:2454] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46b93f7cb3fe4ca7b7f0bc057db7cadd in term 0.
I20260811 02:36:29.813036 19558 leader_election.cc:302] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93f7cb3fe4ca7b7f0bc057db7cadd, eba1e32270d1463891ab4a2a4de03ade; no voters:
I20260811 02:36:29.813294 20043 raft_consensus.cc:2781] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:36:29.813371 20043 raft_consensus.cc:482] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:36:29.813410 20043 raft_consensus.cc:3037] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:29.814222 20043 raft_consensus.cc:504] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.814446 20043 leader_election.cc:288] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [CANDIDATE]: Term 1 election: Requested vote from peers 20c6338ba3a84de8a9fd4f0aa1c122a9 (127.17.79.3:35667), eba1e32270d1463891ab4a2a4de03ade (127.17.79.1:39861)
I20260811 02:36:29.814649 19441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9345713cdc784a34a63b7059d3f6f94f" candidate_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eba1e32270d1463891ab4a2a4de03ade"
I20260811 02:36:29.814646 19914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9345713cdc784a34a63b7059d3f6f94f" candidate_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9"
I20260811 02:36:29.814741 19441 raft_consensus.cc:3037] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:29.814764 19914 raft_consensus.cc:3037] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:29.815474 19441 raft_consensus.cc:2454] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93f7cb3fe4ca7b7f0bc057db7cadd in term 1.
I20260811 02:36:29.815569 19914 raft_consensus.cc:2454] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46b93f7cb3fe4ca7b7f0bc057db7cadd in term 1.
I20260811 02:36:29.815649 19558 leader_election.cc:302] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46b93f7cb3fe4ca7b7f0bc057db7cadd, eba1e32270d1463891ab4a2a4de03ade; no voters:
I20260811 02:36:29.815745 20043 raft_consensus.cc:2781] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:29.815959 20043 raft_consensus.cc:686] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 1 LEADER]: Becoming Leader. State: Replica: 46b93f7cb3fe4ca7b7f0bc057db7cadd, State: Running, Role: LEADER
I20260811 02:36:29.816084 20043 consensus_queue.cc:237] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } }
I20260811 02:36:29.816987 19173 catalog_manager.cc:5495] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd reported cstate change: term changed from 0 to 1, leader changed from <none> to 46b93f7cb3fe4ca7b7f0bc057db7cadd (127.17.79.2). New cstate: current_term: 1 leader_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46b93f7cb3fe4ca7b7f0bc057db7cadd" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 35025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 } health_report { overall_health: UNKNOWN } } }
W20260811 02:36:29.830426 19525 tablet.cc:2369] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:29.848588 20023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.845996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52130 (local address 127.17.79.2:35025)
0811 02:36:29.846064 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:29.846066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:29.846075 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:36:29.846122 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:29.846123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:29.846155 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:29.846215 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:36:29.846408 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.846878 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.847690 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:29.847886 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:29.847950 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:29.848168 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:36:29.848273 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:36:29.848350 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:29.848429 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 02:36:29.848448 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:36:29.850432 19441 raft_consensus.cc:1261] T 9345713cdc784a34a63b7059d3f6f94f P eba1e32270d1463891ab4a2a4de03ade [term 1 FOLLOWER]: Refusing update from remote peer 46b93f7cb3fe4ca7b7f0bc057db7cadd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:29.850483 19914 raft_consensus.cc:1261] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 1 FOLLOWER]: Refusing update from remote peer 46b93f7cb3fe4ca7b7f0bc057db7cadd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:29.850849 20048 consensus_queue.cc:1035] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c6338ba3a84de8a9fd4f0aa1c122a9" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:29.851037 20043 consensus_queue.cc:1035] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [LEADER]: Connected to new peer: Peer: permanent_uuid: "eba1e32270d1463891ab4a2a4de03ade" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 39861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:29.853466 20059 mvcc.cc:205] Tried to move back new op lower bound from 7317159075224465408 to 7317159075087376384. Current Snapshot: MvccSnapshot[applied={T|T < 7317159075224465408}]
I20260811 02:36:29.854125 20055 mvcc.cc:205] Tried to move back new op lower bound from 7317159075224465408 to 7317159075087376384. Current Snapshot: MvccSnapshot[applied={T|T < 7317159075224465408 or (T in {7317159075224465408})}]
I20260811 02:36:29.854750 20057 mvcc.cc:205] Tried to move back new op lower bound from 7317159075224465408 to 7317159075087376384. Current Snapshot: MvccSnapshot[applied={T|T < 7317159075224465408}]
I20260811 02:36:29.855787 19173 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:29.855885 19173 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:29.856596 19173 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e116fce814614d7f83f6d43658bc6814: Sending DeleteTablet for 3 replicas of tablet 9345713cdc784a34a63b7059d3f6f94f
I20260811 02:36:29.856958 19876 tablet_service.cc:1514] Processing DeleteTablet for tablet 9345713cdc784a34a63b7059d3f6f94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:29 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:52138
I20260811 02:36:29.857002 19646 tablet_service.cc:1514] Processing DeleteTablet for tablet 9345713cdc784a34a63b7059d3f6f94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:29 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:52118
I20260811 02:36:29.857297 20072 tablet_replica.cc:330] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: stopping tablet replica
I20260811 02:36:29.857285 19401 tablet_service.cc:1514] Processing DeleteTablet for tablet 9345713cdc784a34a63b7059d3f6f94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:29 UTC) from {username='kudu', principal='kudu/127.17.79.62@KRBTEST.COM'} at 127.0.0.1:59922
I20260811 02:36:29.857419 20072 raft_consensus.cc:2229] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:29.857491 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19291
I20260811 02:36:29.857527 20072 raft_consensus.cc:2258] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:29.867749 20074 tablet_replica.cc:330] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: stopping tablet replica
I20260811 02:36:29.867885 20074 raft_consensus.cc:2229] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:36:29.868002 20074 raft_consensus.cc:2258] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:29.868065 20072 ts_tablet_manager.cc:1905] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:29.868474 20074 ts_tablet_manager.cc:1905] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:29.869693 20072 ts_tablet_manager.cc:1918] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:29.869788 20072 log.cc:1196] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/9345713cdc784a34a63b7059d3f6f94f
I20260811 02:36:29.870095 20072 ts_tablet_manager.cc:1939] T 9345713cdc784a34a63b7059d3f6f94f P 20c6338ba3a84de8a9fd4f0aa1c122a9: Deleting consensus metadata
I20260811 02:36:29.870148 20074 ts_tablet_manager.cc:1918] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:29.870251 20074 log.cc:1196] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/9345713cdc784a34a63b7059d3f6f94f
I20260811 02:36:29.870540 20074 ts_tablet_manager.cc:1939] T 9345713cdc784a34a63b7059d3f6f94f P 46b93f7cb3fe4ca7b7f0bc057db7cadd: Deleting consensus metadata
I20260811 02:36:29.870600 19145 catalog_manager.cc:4841] TS 20c6338ba3a84de8a9fd4f0aa1c122a9 (127.17.79.3:35667): tablet 9345713cdc784a34a63b7059d3f6f94f (table test-table [id=483db88b0e6342bc94b4887f9a43a4a7]) successfully deleted
I20260811 02:36:29.870991 19142 catalog_manager.cc:4841] TS 46b93f7cb3fe4ca7b7f0bc057db7cadd (127.17.79.2:35025): tablet 9345713cdc784a34a63b7059d3f6f94f (table test-table [id=483db88b0e6342bc94b4887f9a43a4a7]) successfully deleted
W20260811 02:36:29.874805 19142 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:39861 (error 108)
I20260811 02:36:29.875072 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19534
I20260811 02:36:29.880679 20020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:29.880485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:39861 (local address 127.0.0.1:59924)
0811 02:36:29.880561 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:29.880625 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:39861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 02:36:29.880858 19142 catalog_manager.cc:4584] TS eba1e32270d1463891ab4a2a4de03ade (127.17.79.1:39861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9345713cdc784a34a63b7059d3f6f94f: Network error: Client connection negotiation failed: client connection to 127.17.79.1:39861: connect: Connection refused (error 111)
I20260811 02:36:29.893074 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19767
I20260811 02:36:29.906884 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 19108
2026-08-11T02:36:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2325 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T02:36:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:29Z Disabled control of system clock
I20260811 02:36:29.948055 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33459
--webserver_interface=127.17.79.62
--webserver_port=0
--builtin_ntp_servers=127.17.79.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:33459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:30.034065 20083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:30.034315 20083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:30.034337 20083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:30.035400 20083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:30.035434 20083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:30.035447 20083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:30.035459 20083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:30.035471 20083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:30.036741 20083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:33459
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:33459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:30.036932 20083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:30.037163 20083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:30.042003 20093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:30.042014 20096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:30.042145 20100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:30.042482 20083 server_base.cc:1034] running on GCE node
I20260811 02:36:30.042726 20083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:30.043035 20083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:30.044193 20083 hybrid_clock.cc:648] HybridClock initialized: now 1786415790044171 us; error 37 us; skew 500 ppm
I20260811 02:36:30.045644 20083 webserver.cc:460] Webserver started at http://127.17.79.62:38503/ using document root <none> and password file <none>
I20260811 02:36:30.045849 20083 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:30.045895 20083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:30.045991 20083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:30.047333 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "f0d551d02da24675829941d0a47359a6"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "4b52cfc15c62e4cfaf2434f150b6aaee"
server_key_iv: "466992d36b700865486bc3fe21cc8fa9"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.047652 20083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "f0d551d02da24675829941d0a47359a6"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "4b52cfc15c62e4cfaf2434f150b6aaee"
server_key_iv: "466992d36b700865486bc3fe21cc8fa9"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.049043 20083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:36:30.049849 20110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.050031 20083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:36:30.050112 20083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "f0d551d02da24675829941d0a47359a6"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "4b52cfc15c62e4cfaf2434f150b6aaee"
server_key_iv: "466992d36b700865486bc3fe21cc8fa9"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.050169 20083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:30.066702 20083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:30.066978 20083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:30.067082 20083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:30.071282 20083 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:33459
I20260811 02:36:30.071341 20220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:33459 every 8 connection(s)
I20260811 02:36:30.071664 20083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:30.072667 20223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:30.072942 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 20083
I20260811 02:36:30.073046 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:30.073257 17724 external_mini_cluster.cc:1428] Setting key 6178e5eb7648cee5850e1edb7a9c80c4
I20260811 02:36:30.076054 20223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6: Bootstrap starting.
I20260811 02:36:30.076756 20223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:30.077049 20223 log.cc:824] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:30.077905 20223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6: No bootstrap required, opened a new log
I20260811 02:36:30.078850 20231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.073785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33088 (local address 127.17.79.62:33459)
0811 02:36:30.073982 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.073989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.074012 (+ 23us) server_negotiation.cc:407] Connection header received
0811 02:36:30.074482 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.074489 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.074548 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.074660 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:30.074915 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.075764 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.076846 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.077321 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.077413 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.078140 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:30.078145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:30.078145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:30.078374 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:30.078414 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:30.078428 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:30.078501 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.078555 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.078630 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260811 02:36:30.080238 20223 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d551d02da24675829941d0a47359a6" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33459 } }
I20260811 02:36:30.080366 20223 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:30.080389 20223 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d551d02da24675829941d0a47359a6, State: Initialized, Role: FOLLOWER
I20260811 02:36:30.080523 20223 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d551d02da24675829941d0a47359a6" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33459 } }
I20260811 02:36:30.080593 20223 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:30.080615 20223 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:30.080658 20223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:30.081207 20223 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d551d02da24675829941d0a47359a6" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33459 } }
I20260811 02:36:30.081297 20223 leader_election.cc:302] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0d551d02da24675829941d0a47359a6; no voters:
I20260811 02:36:30.081475 20223 leader_election.cc:288] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:30.081511 20233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:30.081701 20233 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [term 1 LEADER]: Becoming Leader. State: Replica: f0d551d02da24675829941d0a47359a6, State: Running, Role: LEADER
I20260811 02:36:30.081751 20223 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:30.081792 20233 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d551d02da24675829941d0a47359a6" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33459 } }
I20260811 02:36:30.082087 20234 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0d551d02da24675829941d0a47359a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d551d02da24675829941d0a47359a6" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33459 } } }
I20260811 02:36:30.082089 20237 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0d551d02da24675829941d0a47359a6. Latest consensus state: current_term: 1 leader_uuid: "f0d551d02da24675829941d0a47359a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d551d02da24675829941d0a47359a6" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 33459 } } }
I20260811 02:36:30.082208 20234 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:30.082216 20237 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:30.082590 20244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:30.083189 20244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:30.084613 20244 catalog_manager.cc:1347] Generated new cluster ID: dced70c292bf40d393fa19949b895adf
I20260811 02:36:30.084667 20244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:30.109229 20244 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:30.109898 20244 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:30.127482 20244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6: Generated new TSK 0
I20260811 02:36:30.127724 20244 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:30.136098 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.1:0
--local_ip_for_outbound_sockets=127.17.79.1
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33459
--builtin_ntp_servers=127.17.79.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:30.221099 20272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:30.221349 20272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:30.221390 20272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:30.222615 20272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:30.222673 20272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:30.222718 20272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.1
I20260811 02:36:30.224105 20272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.79.1
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.1
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:30.224391 20272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:30.224715 20272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:30.230036 20278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:30.230031 20277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:30.230419 20272 server_base.cc:1034] running on GCE node
W20260811 02:36:30.230029 20281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:30.230726 20272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:30.230973 20272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:30.232136 20272 hybrid_clock.cc:648] HybridClock initialized: now 1786415790232130 us; error 35 us; skew 500 ppm
I20260811 02:36:30.233449 20272 webserver.cc:460] Webserver started at http://127.17.79.1:42509/ using document root <none> and password file <none>
I20260811 02:36:30.233723 20272 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:30.233796 20272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:30.233951 20272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:30.235132 20272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data/instance:
uuid: "cd862b17d3a94037b878e0c99080a8fe"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "df7e472cc4716c27c56bb5fe1ca53b5a"
server_key_iv: "1a0356fde44b1a83c093a59d4b06b17e"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.235505 20272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance:
uuid: "cd862b17d3a94037b878e0c99080a8fe"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "df7e472cc4716c27c56bb5fe1ca53b5a"
server_key_iv: "1a0356fde44b1a83c093a59d4b06b17e"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.236948 20272 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:36:30.237953 20298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.238168 20272 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:30.238504 20272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/wal
uuid: "cd862b17d3a94037b878e0c99080a8fe"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "df7e472cc4716c27c56bb5fe1ca53b5a"
server_key_iv: "1a0356fde44b1a83c093a59d4b06b17e"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.238587 20272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:30.259069 20272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:30.259423 20272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:30.259582 20272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:30.259850 20272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:30.260221 20272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:30.260257 20272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.260280 20272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:30.260324 20272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.266274 20272 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.1:35015
I20260811 02:36:30.266345 20526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.1:35015 every 8 connection(s)
I20260811 02:36:30.266754 20272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/data/info.pb
I20260811 02:36:30.272333 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 20272
I20260811 02:36:30.272454 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-0/wal/instance
I20260811 02:36:30.272678 17724 external_mini_cluster.cc:1428] Setting key f5546d06ee5b460def419fd4368f1170
I20260811 02:36:30.273005 20231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.267587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.1:42207 (local address 127.17.79.62:33459)
0811 02:36:30.267644 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.267646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.267906 (+ 260us) server_negotiation.cc:407] Connection header received
0811 02:36:30.268670 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.268672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.268699 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.268753 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:30.269563 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.270097 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.271238 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.271495 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.271598 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.272615 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:30.272618 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:30.272618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:30.272626 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:30.272652 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:30.272658 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:30.272721 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.272851 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.272902 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 02:36:30.273274 20530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.267558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33459 (local address 127.17.79.1:42207)
0811 02:36:30.267762 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.267808 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.268530 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.268817 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.268821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.268831 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:30.269470 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.269476 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.270186 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.270198 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.271057 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.271059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.271618 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.271619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.271734 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.272364 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:30.272365 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:30.272410 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:30.272468 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:30.272736 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:30.272743 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:30.272747 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.272839 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.273055 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
I20260811 02:36:30.273732 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.2:0
--local_ip_for_outbound_sockets=127.17.79.2
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33459
--builtin_ntp_servers=127.17.79.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 02:36:30.273757 20528 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33459
I20260811 02:36:30.273847 20528 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:30.274039 20528 heartbeater.cc:511] Master 127.17.79.62:33459 requested a full tablet report, sending...
I20260811 02:36:30.274538 20140 ts_manager.cc:194] Registered new tserver with Master: cd862b17d3a94037b878e0c99080a8fe (127.17.79.1:35015)
I20260811 02:36:30.275130 20140 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.1:42207
W20260811 02:36:30.357179 20532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:30.357384 20532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:30.357405 20532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:30.358534 20532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:30.358573 20532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:30.358597 20532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.2
I20260811 02:36:30.359906 20532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.79.2
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.2
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:30.360108 20532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:30.360353 20532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:30.365453 20547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:30.365526 20543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:30.365644 20532 server_base.cc:1034] running on GCE node
W20260811 02:36:30.365756 20544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:30.365978 20532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:30.366302 20532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:30.367482 20532 hybrid_clock.cc:648] HybridClock initialized: now 1786415790367477 us; error 34 us; skew 500 ppm
I20260811 02:36:30.368844 20532 webserver.cc:460] Webserver started at http://127.17.79.2:40589/ using document root <none> and password file <none>
I20260811 02:36:30.369112 20532 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:30.369204 20532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:30.369364 20532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:30.370527 20532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data/instance:
uuid: "e98c0a1ba42e41c8aceeb20977b43474"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "03b95680ffe0992c6e03485c76525215"
server_key_iv: "135fb998515f826ebdcb71fc654a6cc0"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.370893 20532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance:
uuid: "e98c0a1ba42e41c8aceeb20977b43474"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "03b95680ffe0992c6e03485c76525215"
server_key_iv: "135fb998515f826ebdcb71fc654a6cc0"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.372347 20532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:30.373224 20558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.373446 20532 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:30.373574 20532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal
uuid: "e98c0a1ba42e41c8aceeb20977b43474"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "03b95680ffe0992c6e03485c76525215"
server_key_iv: "135fb998515f826ebdcb71fc654a6cc0"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.373656 20532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:30.393260 20532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:30.393607 20532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:30.393775 20532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:30.394032 20532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:30.394502 20532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:30.394577 20532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.394611 20532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:30.394644 20532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.400918 20532 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.2:44307
I20260811 02:36:30.400966 20795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.2:44307 every 8 connection(s)
I20260811 02:36:30.401340 20532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/data/info.pb
I20260811 02:36:30.406596 20231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.402145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:44273 (local address 127.17.79.62:33459)
0811 02:36:30.402262 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.402264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.402469 (+ 205us) server_negotiation.cc:407] Connection header received
0811 02:36:30.402952 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.402953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.402963 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.403019 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:30.403726 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.404240 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.405250 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.405431 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.405487 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.406385 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:30.406386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:30.406387 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:30.406391 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:30.406403 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:30.406407 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:30.406450 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.406514 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.406534 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 02:36:30.406857 20798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.402096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33459 (local address 127.17.79.2:44273)
0811 02:36:30.402345 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.402381 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.402866 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.403070 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.403072 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.403080 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:30.403626 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.403630 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.404357 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.404358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.405156 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.405158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.405508 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.405508 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.405614 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.406256 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:30.406257 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:30.406286 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:30.406310 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:30.406450 (+ 140us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:30.406453 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:30.406455 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.406502 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.406587 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":107,"threads_started":1}
I20260811 02:36:30.407469 20796 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33459
I20260811 02:36:30.407557 20796 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:30.407748 20796 heartbeater.cc:511] Master 127.17.79.62:33459 requested a full tablet report, sending...
I20260811 02:36:30.408314 20140 ts_manager.cc:194] Registered new tserver with Master: e98c0a1ba42e41c8aceeb20977b43474 (127.17.79.2:44307)
I20260811 02:36:30.408943 20140 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.2:44273
I20260811 02:36:30.410045 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 20532
I20260811 02:36:30.410132 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal/instance
I20260811 02:36:30.410372 17724 external_mini_cluster.cc:1428] Setting key 29937caad5cab306442962765c78783f
I20260811 02:36:30.411495 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.79.3:0
--local_ip_for_outbound_sockets=127.17.79.3
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33459
--builtin_ntp_servers=127.17.79.20:42317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 02:36:30.505795 20800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:30.506007 20800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:30.506029 20800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:30.507520 20800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:30.507567 20800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:30.507594 20800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.79.3
I20260811 02:36:30.508986 20800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.79.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.79.3
--webserver_port=0
--tserver_master_addrs=127.17.79.62:33459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.79.3
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:30.509259 20800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:30.509581 20800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:30.514647 20816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:30.514688 20811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:30.514752 20813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:30.515077 20800 server_base.cc:1034] running on GCE node
I20260811 02:36:30.515317 20800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:30.515561 20800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:30.516709 20800 hybrid_clock.cc:648] HybridClock initialized: now 1786415790516700 us; error 31 us; skew 500 ppm
I20260811 02:36:30.518141 20800 webserver.cc:460] Webserver started at http://127.17.79.3:37463/ using document root <none> and password file <none>
I20260811 02:36:30.518432 20800 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:30.518507 20800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:30.518672 20800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:30.519728 20800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data/instance:
uuid: "4d4cff8f77b34a55b2c6950471d3a59f"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "7d191211309950cd92e500b83b4555fc"
server_key_iv: "395f795d14d313ea5a6069894bc61e71"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.520102 20800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance:
uuid: "4d4cff8f77b34a55b2c6950471d3a59f"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "7d191211309950cd92e500b83b4555fc"
server_key_iv: "395f795d14d313ea5a6069894bc61e71"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.521484 20800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:30.522372 20832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.522549 20800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:30.522655 20800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal
uuid: "4d4cff8f77b34a55b2c6950471d3a59f"
format_stamp: "Formatted at 2026-08-11 02:36:30 on dist-test-slave-7nm7"
server_key: "7d191211309950cd92e500b83b4555fc"
server_key_iv: "395f795d14d313ea5a6069894bc61e71"
server_key_version: "encryptionkey@0"
I20260811 02:36:30.522737 20800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:30.532946 20800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:30.533246 20800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:30.533398 20800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:30.533624 20800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 02:36:30.533996 20800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 02:36:30.534051 20800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.534091 20800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 02:36:30.534126 20800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:30.540122 20800 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.3:35523
I20260811 02:36:30.540201 21052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.3:35523 every 8 connection(s)
I20260811 02:36:30.540532 20800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/data/info.pb
I20260811 02:36:30.545811 20231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.541552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.3:55471 (local address 127.17.79.62:33459)
0811 02:36:30.541608 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.541610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.541631 (+ 21us) server_negotiation.cc:407] Connection header received
0811 02:36:30.542104 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.542105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.542115 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.542169 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:30.542968 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.543457 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.544425 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.544644 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.544724 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.545537 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:30.545539 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:30.545539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:30.545543 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:30.545559 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:30.545563 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:30.545615 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.545729 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.545752 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 02:36:30.545949 21055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.541290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:33459 (local address 127.17.79.3:55471)
0811 02:36:30.541467 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.541523 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.542016 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.542373 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.542376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.542384 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:36:30.542875 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.542879 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.543544 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.543545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.544321 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.544322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.544736 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.544736 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.544854 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.545395 (+ 541us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 02:36:30.545396 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:36:30.545422 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 02:36:30.545444 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:36:30.545623 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:36:30.545627 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:36:30.545629 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.545681 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.545756 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":71,"threads_started":1}
I20260811 02:36:30.546566 21053 heartbeater.cc:347] Connected to a master server at 127.17.79.62:33459
I20260811 02:36:30.546671 21053 heartbeater.cc:464] Registering TS with master...
I20260811 02:36:30.546846 21053 heartbeater.cc:511] Master 127.17.79.62:33459 requested a full tablet report, sending...
I20260811 02:36:30.547266 20140 ts_manager.cc:194] Registered new tserver with Master: 4d4cff8f77b34a55b2c6950471d3a59f (127.17.79.3:35523)
I20260811 02:36:30.547652 20140 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.79.3:55471
I20260811 02:36:30.547926 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 20800
I20260811 02:36:30.548041 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal/instance
I20260811 02:36:30.548249 17724 external_mini_cluster.cc:1428] Setting key 5733383b1ab37ae7b8cf2a92116f7fd6
I20260811 02:36:30.549023 17724 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 02:36:30.553750 20231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.550721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33096 (local address 127.17.79.62:33459)
0811 02:36:30.550795 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.550797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.550907 (+ 110us) server_negotiation.cc:407] Connection header received
0811 02:36:30.550985 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.550986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.551002 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.551058 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:30.551248 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.551697 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.552434 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.552670 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.552745 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.553504 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:30.553505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:30.553506 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:30.553510 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:30.553523 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:30.553527 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:30.553571 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.553643 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.553663 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 02:36:30.555409 20140 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 02:36:30.556901 20140 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 02:36:30.563197 21079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.559100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.2:44307 (local address 127.0.0.1:41450)
0811 02:36:30.559242 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.559284 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.559355 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.559889 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.559889 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.559892 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:30.559951 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.559953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.560824 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.560825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.561997 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.562000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.562898 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.562900 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.562978 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.562991 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.563065 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.563111 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":95,"threads_started":1}
I20260811 02:36:30.563403 21078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.559114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:35523 (local address 127.0.0.1:58642)
0811 02:36:30.559462 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.559471 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.559512 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.559949 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.559949 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.559951 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:30.559982 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.559983 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.561241 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.561243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.562307 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.562314 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.563172 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.563173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.563252 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.563258 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.563293 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.563343 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":91,"threads_started":1}
I20260811 02:36:30.563210 21081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.559389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41450 (local address 127.17.79.2:44307)
0811 02:36:30.559579 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.559584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.559595 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:36:30.559638 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.559640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.559659 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.560036 (+ 377us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:30.560082 (+ 46us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.560735 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.562082 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.562800 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.562878 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.562969 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.563076 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.563126 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":105,"threads_started":1}
I20260811 02:36:30.563792 21086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.559592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58642 (local address 127.17.79.3:35523)
0811 02:36:30.559786 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.559790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.559799 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:36:30.559832 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.559834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.559847 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.560053 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:30.560103 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.561154 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.562381 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.563074 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.563565 (+ 491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.563662 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.563687 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.563734 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":90,"threads_started":1}
I20260811 02:36:30.564395 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.559106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:35015 (local address 127.0.0.1:55166)
0811 02:36:30.559298 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.559309 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.559365 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.559798 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.559801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.559803 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:30.559875 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.559877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.562382 (+ 2505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.562382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.563178 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.563180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.564178 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.564179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.564255 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.564258 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.564322 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.564350 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":89,"threads_started":1}
I20260811 02:36:30.564318 20670 tablet_service.cc:1467] Processing CreateTablet for tablet 49cc1004dbd44783acbf65b3628a7b0a (DEFAULT_TABLE table=test-table [id=172808302f874d748cb17837e7763d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:30.564456 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.559383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.17.79.1:35015)
0811 02:36:30.559592 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.559596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.559605 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:36:30.559648 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.559649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.559660 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.559956 (+ 296us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:30.560015 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.561150 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.563272 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.564056 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.564173 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.564259 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.564337 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.564374 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":106,"threads_started":1}
I20260811 02:36:30.564726 20670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49cc1004dbd44783acbf65b3628a7b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:30.565030 20387 tablet_service.cc:1467] Processing CreateTablet for tablet 49cc1004dbd44783acbf65b3628a7b0a (DEFAULT_TABLE table=test-table [id=172808302f874d748cb17837e7763d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:30.565279 20387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49cc1004dbd44783acbf65b3628a7b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:30.567678 21087 tablet_bootstrap.cc:492] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Bootstrap starting.
I20260811 02:36:30.568267 20917 tablet_service.cc:1467] Processing CreateTablet for tablet 49cc1004dbd44783acbf65b3628a7b0a (DEFAULT_TABLE table=test-table [id=172808302f874d748cb17837e7763d2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 02:36:30.568567 21087 tablet_bootstrap.cc:654] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:30.568596 20917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49cc1004dbd44783acbf65b3628a7b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:30.568908 21087 log.cc:824] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:30.569716 21087 tablet_bootstrap.cc:492] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: No bootstrap required, opened a new log
I20260811 02:36:30.569794 21087 ts_tablet_manager.cc:1397] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:30.570722 21088 tablet_bootstrap.cc:492] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: Bootstrap starting.
I20260811 02:36:30.571296 21088 tablet_bootstrap.cc:654] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:30.571593 21088 log.cc:824] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:30.571970 21092 tablet_bootstrap.cc:492] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Bootstrap starting.
I20260811 02:36:30.572431 21088 tablet_bootstrap.cc:492] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: No bootstrap required, opened a new log
I20260811 02:36:30.572510 21088 ts_tablet_manager.cc:1397] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:30.572396 21087 raft_consensus.cc:348] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.572556 21087 raft_consensus.cc:374] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:30.572598 21087 raft_consensus.cc:729] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98c0a1ba42e41c8aceeb20977b43474, State: Initialized, Role: FOLLOWER
I20260811 02:36:30.572604 21092 tablet_bootstrap.cc:654] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:30.572736 21087 consensus_queue.cc:260] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.572930 21092 log.cc:824] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:30.572991 21087 ts_tablet_manager.cc:1428] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 02:36:30.573168 20796 heartbeater.cc:503] Master 127.17.79.62:33459 was elected leader, sending a full tablet report...
I20260811 02:36:30.574003 21092 tablet_bootstrap.cc:492] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: No bootstrap required, opened a new log
I20260811 02:36:30.574079 21092 ts_tablet_manager.cc:1397] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 02:36:30.575275 21088 raft_consensus.cc:348] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.575446 21088 raft_consensus.cc:374] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:30.575484 21088 raft_consensus.cc:729] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd862b17d3a94037b878e0c99080a8fe, State: Initialized, Role: FOLLOWER
I20260811 02:36:30.575600 21088 consensus_queue.cc:260] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.575856 21088 ts_tablet_manager.cc:1428] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 02:36:30.575910 20528 heartbeater.cc:503] Master 127.17.79.62:33459 was elected leader, sending a full tablet report...
I20260811 02:36:30.576576 21092 raft_consensus.cc:348] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.576689 21092 raft_consensus.cc:374] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:30.576709 21092 raft_consensus.cc:729] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4cff8f77b34a55b2c6950471d3a59f, State: Initialized, Role: FOLLOWER
I20260811 02:36:30.576853 21092 consensus_queue.cc:260] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.577180 21092 ts_tablet_manager.cc:1428] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 02:36:30.577221 21053 heartbeater.cc:503] Master 127.17.79.62:33459 was elected leader, sending a full tablet report...
W20260811 02:36:30.651937 20797 tablet.cc:2369] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:36:30.767515 20529 tablet.cc:2369] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 02:36:30.791136 21054 tablet.cc:2369] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 02:36:30.966176 21093 raft_consensus.cc:482] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 02:36:30.966352 21093 raft_consensus.cc:504] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.966820 21093 leader_election.cc:288] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd862b17d3a94037b878e0c99080a8fe (127.17.79.1:35015), 4d4cff8f77b34a55b2c6950471d3a59f (127.17.79.3:35523)
I20260811 02:36:30.969872 21086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.967106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:33617 (local address 127.17.79.3:35523)
0811 02:36:30.967157 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.967159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.967381 (+ 222us) server_negotiation.cc:407] Connection header received
0811 02:36:30.967465 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.967466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.967478 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.967561 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:30.967727 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.968205 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.969152 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.969513 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.969598 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.969609 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.969763 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.969799 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:36:30.969921 21098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.967040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.3:35523 (local address 127.17.79.2:33617)
0811 02:36:30.967200 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.967293 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.967395 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.967566 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.967567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.967569 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:30.967654 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.967656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.968295 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.968297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.969054 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.969056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.969601 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.969602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.969681 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.969687 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.969755 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.969798 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":72,"threads_started":1}
I20260811 02:36:30.969952 21099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.967055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:35015 (local address 127.17.79.2:45171)
0811 02:36:30.967236 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:30.967246 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:36:30.967446 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:36:30.967616 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:36:30.967617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:36:30.967619 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 02:36:30.967724 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.967726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.968362 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.968363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.969107 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:36:30.969109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.969656 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.969657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:36:30.969746 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.969749 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 02:36:30.969812 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 02:36:30.969852 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":18,"thread_start_us":96,"threads_started":1}
I20260811 02:36:30.969940 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:30.967151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.79.2:45171 (local address 127.17.79.1:35015)
0811 02:36:30.967207 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:30.967209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:30.967412 (+ 203us) server_negotiation.cc:407] Connection header received
0811 02:36:30.967523 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:30.967524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:30.967542 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:30.967612 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 02:36:30.967801 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.968276 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.969208 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:30.969552 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:30.969638 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:30.969648 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:30.969835 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 02:36:30.969873 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 02:36:30.970320 20428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49cc1004dbd44783acbf65b3628a7b0a" candidate_uuid: "e98c0a1ba42e41c8aceeb20977b43474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd862b17d3a94037b878e0c99080a8fe" is_pre_election: true
I20260811 02:36:30.970410 20965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49cc1004dbd44783acbf65b3628a7b0a" candidate_uuid: "e98c0a1ba42e41c8aceeb20977b43474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" is_pre_election: true
I20260811 02:36:30.970505 20428 raft_consensus.cc:2454] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98c0a1ba42e41c8aceeb20977b43474 in term 0.
I20260811 02:36:30.970530 20965 raft_consensus.cc:2454] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98c0a1ba42e41c8aceeb20977b43474 in term 0.
I20260811 02:36:30.970759 20567 leader_election.cc:302] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4cff8f77b34a55b2c6950471d3a59f, e98c0a1ba42e41c8aceeb20977b43474; no voters:
I20260811 02:36:30.970888 21093 raft_consensus.cc:2781] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 02:36:30.970947 21093 raft_consensus.cc:482] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 02:36:30.970981 21093 raft_consensus.cc:3037] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:30.971732 21093 raft_consensus.cc:504] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.971889 21093 leader_election.cc:288] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [CANDIDATE]: Term 1 election: Requested vote from peers cd862b17d3a94037b878e0c99080a8fe (127.17.79.1:35015), 4d4cff8f77b34a55b2c6950471d3a59f (127.17.79.3:35523)
I20260811 02:36:30.972090 20965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49cc1004dbd44783acbf65b3628a7b0a" candidate_uuid: "e98c0a1ba42e41c8aceeb20977b43474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d4cff8f77b34a55b2c6950471d3a59f"
I20260811 02:36:30.972182 20428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49cc1004dbd44783acbf65b3628a7b0a" candidate_uuid: "e98c0a1ba42e41c8aceeb20977b43474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd862b17d3a94037b878e0c99080a8fe"
I20260811 02:36:30.972220 20965 raft_consensus.cc:3037] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:30.972255 20428 raft_consensus.cc:3037] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:30.973296 20965 raft_consensus.cc:2454] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98c0a1ba42e41c8aceeb20977b43474 in term 1.
I20260811 02:36:30.973300 20428 raft_consensus.cc:2454] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98c0a1ba42e41c8aceeb20977b43474 in term 1.
I20260811 02:36:30.973519 20567 leader_election.cc:302] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4cff8f77b34a55b2c6950471d3a59f, e98c0a1ba42e41c8aceeb20977b43474; no voters:
I20260811 02:36:30.973654 21093 raft_consensus.cc:2781] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:30.973827 21093 raft_consensus.cc:686] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 1 LEADER]: Becoming Leader. State: Replica: e98c0a1ba42e41c8aceeb20977b43474, State: Running, Role: LEADER
I20260811 02:36:30.973960 21093 consensus_queue.cc:237] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } }
I20260811 02:36:30.975219 20140 catalog_manager.cc:5495] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98c0a1ba42e41c8aceeb20977b43474 (127.17.79.2). New cstate: current_term: 1 leader_uuid: "e98c0a1ba42e41c8aceeb20977b43474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98c0a1ba42e41c8aceeb20977b43474" member_type: VOTER last_known_addr { host: "127.17.79.2" port: 44307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 } health_report { overall_health: UNKNOWN } } }
I20260811 02:36:31.005082 21081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:31.002616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41460 (local address 127.17.79.2:44307)
0811 02:36:31.002696 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:31.002698 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:31.002706 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:36:31.002746 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:31.002747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:31.002767 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:31.002834 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:36:31.002975 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:31.003465 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:31.004244 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:31.004431 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:31.004485 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:31.004663 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:36:31.004783 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:36:31.004856 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:31.004938 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 02:36:31.004958 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 02:36:31.007045 20428 raft_consensus.cc:1261] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 1 FOLLOWER]: Refusing update from remote peer e98c0a1ba42e41c8aceeb20977b43474: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:31.007045 20965 raft_consensus.cc:1261] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 1 FOLLOWER]: Refusing update from remote peer e98c0a1ba42e41c8aceeb20977b43474: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:36:31.007442 21093 consensus_queue.cc:1035] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d4cff8f77b34a55b2c6950471d3a59f" member_type: VOTER last_known_addr { host: "127.17.79.3" port: 35523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:31.007573 21100 consensus_queue.cc:1035] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd862b17d3a94037b878e0c99080a8fe" member_type: VOTER last_known_addr { host: "127.17.79.1" port: 35015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:36:31.010075 21105 mvcc.cc:205] Tried to move back new op lower bound from 7317159079961874432 to 7317159079830663168. Current Snapshot: MvccSnapshot[applied={T|T < 7317159079961874432}]
I20260811 02:36:31.010295 21108 mvcc.cc:205] Tried to move back new op lower bound from 7317159079961874432 to 7317159079830663168. Current Snapshot: MvccSnapshot[applied={T|T < 7317159079961874432}]
I20260811 02:36:31.011312 21110 mvcc.cc:205] Tried to move back new op lower bound from 7317159079961874432 to 7317159079830663168. Current Snapshot: MvccSnapshot[applied={T|T < 7317159079961874432}]
I20260811 02:36:31.012753 20138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:31.012856 20138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 02:36:31.013703 20138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0d551d02da24675829941d0a47359a6: Sending DeleteTablet for 3 replicas of tablet 49cc1004dbd44783acbf65b3628a7b0a
I20260811 02:36:31.014078 20387 tablet_service.cc:1514] Processing DeleteTablet for tablet 49cc1004dbd44783acbf65b3628a7b0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:31 UTC) from {username='slave'} at 127.0.0.1:55166
I20260811 02:36:31.014119 20670 tablet_service.cc:1514] Processing DeleteTablet for tablet 49cc1004dbd44783acbf65b3628a7b0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:31 UTC) from {username='slave'} at 127.0.0.1:41450
I20260811 02:36:31.014393 21129 tablet_replica.cc:330] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: stopping tablet replica
I20260811 02:36:31.014407 20917 tablet_service.cc:1514] Processing DeleteTablet for tablet 49cc1004dbd44783acbf65b3628a7b0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 02:36:31 UTC) from {username='slave'} at 127.0.0.1:58642
I20260811 02:36:31.014521 21125 tablet_replica.cc:330] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe: stopping tablet replica
I20260811 02:36:31.014549 21129 raft_consensus.cc:2229] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 1 LEADER]: Raft consensus shutting down.
I20260811 02:36:31.014613 21125 raft_consensus.cc:2229] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:31.014648 21129 raft_consensus.cc:2258] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:31.014706 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 20272
I20260811 02:36:31.014734 21125 raft_consensus.cc:2258] T 49cc1004dbd44783acbf65b3628a7b0a P cd862b17d3a94037b878e0c99080a8fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:31.020108 21129 ts_tablet_manager.cc:1905] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:31.026791 21129 ts_tablet_manager.cc:1918] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:31.026885 21129 log.cc:1196] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-1/wal/wals/49cc1004dbd44783acbf65b3628a7b0a
I20260811 02:36:31.027136 21129 ts_tablet_manager.cc:1939] T 49cc1004dbd44783acbf65b3628a7b0a P e98c0a1ba42e41c8aceeb20977b43474: Deleting consensus metadata
I20260811 02:36:31.027590 20115 catalog_manager.cc:4841] TS e98c0a1ba42e41c8aceeb20977b43474 (127.17.79.2:44307): tablet 49cc1004dbd44783acbf65b3628a7b0a (table test-table [id=172808302f874d748cb17837e7763d2c]) successfully deleted
I20260811 02:36:31.030717 21131 tablet_replica.cc:330] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: stopping tablet replica
I20260811 02:36:31.031747 21131 raft_consensus.cc:2229] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 02:36:31.031916 21131 raft_consensus.cc:2258] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 02:36:31.032401 21131 ts_tablet_manager.cc:1905] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 02:36:31.033989 21131 ts_tablet_manager.cc:1918] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 02:36:31.034081 21131 log.cc:1196] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Deleting WAL directory at /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786415535404356-17724-0/minicluster-data/ts-2/wal/wals/49cc1004dbd44783acbf65b3628a7b0a
I20260811 02:36:31.034432 21131 ts_tablet_manager.cc:1939] T 49cc1004dbd44783acbf65b3628a7b0a P 4d4cff8f77b34a55b2c6950471d3a59f: Deleting consensus metadata
I20260811 02:36:31.034883 20114 catalog_manager.cc:4841] TS 4d4cff8f77b34a55b2c6950471d3a59f (127.17.79.3:35523): tablet 49cc1004dbd44783acbf65b3628a7b0a (table test-table [id=172808302f874d748cb17837e7763d2c]) successfully deleted
W20260811 02:36:31.037081 20111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.79.1:35015 (error 108)
I20260811 02:36:31.037817 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:31.037673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.1:35015 (local address 127.0.0.1:55174)
0811 02:36:31.037736 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 02:36:31.037787 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.1:35015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:36:31.037941 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 20532
W20260811 02:36:31.039032 20111 catalog_manager.cc:4584] TS cd862b17d3a94037b878e0c99080a8fe (127.17.79.1:35015): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 49cc1004dbd44783acbf65b3628a7b0a: Network error: Client connection negotiation failed: client connection to 127.17.79.1:35015: connect: Connection refused (error 111)
I20260811 02:36:31.052842 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 20800
I20260811 02:36:31.064667 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 20083
2026-08-11T02:36:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1154 ms)
[----------] 6 tests from EncryptionPolicyTest (10178 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:31 dist-test-slave-7nm7 krb5kdc[21139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:31 dist-test-slave-7nm7 krb5kdc[21139](info): set up 2 sockets
Aug 11 02:36:31 dist-test-slave-7nm7 krb5kdc[21139](info): commencing operation
krb5kdc: starting...
W20260811 02:36:32.356366 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:32 dist-test-slave-7nm7 krb5kdc[21139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:32.483240 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45865
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:32.563484 21166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:32.563676 21166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:32.563706 21166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:32.564836 21166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:32.564878 21166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:32.564893 21166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:32.564906 21166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:32.564957 21166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:32.566423 21166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45865
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:32.566663 21166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:32.566903 21166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:32.571744 21177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:32.571725 21175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:32.571862 21166 server_base.cc:1034] running on GCE node
W20260811 02:36:32.571725 21179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:32.572144 21166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:32.572470 21166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:32.573632 21166 hybrid_clock.cc:648] HybridClock initialized: now 1786415792573610 us; error 38 us; skew 500 ppm
Aug 11 02:36:32 dist-test-slave-7nm7 krb5kdc[21139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415792, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:32.576094 21166 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:32.576565 21166 webserver.cc:460] Webserver started at http://127.0.0.1:36193/ using document root <none> and password file <none>
I20260811 02:36:32.576790 21166 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:32.576859 21166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:32.577013 21166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:32.578050 21166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "8dc14a46d99e44e0845d67cee7efdedf"
format_stamp: "Formatted at 2026-08-11 02:36:32 on dist-test-slave-7nm7"
server_key: "ce0dc1219bc58efe3b321acbe27aec88"
server_key_iv: "299c57debffd8c9bb5a600a2227edeae"
server_key_version: "encryptionkey@0"
I20260811 02:36:32.578437 21166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "8dc14a46d99e44e0845d67cee7efdedf"
format_stamp: "Formatted at 2026-08-11 02:36:32 on dist-test-slave-7nm7"
server_key: "ce0dc1219bc58efe3b321acbe27aec88"
server_key_iv: "299c57debffd8c9bb5a600a2227edeae"
server_key_version: "encryptionkey@0"
I20260811 02:36:32.579787 21166 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:32.580569 21192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:32.580739 21166 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:32.580843 21166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "8dc14a46d99e44e0845d67cee7efdedf"
format_stamp: "Formatted at 2026-08-11 02:36:32 on dist-test-slave-7nm7"
server_key: "ce0dc1219bc58efe3b321acbe27aec88"
server_key_iv: "299c57debffd8c9bb5a600a2227edeae"
server_key_version: "encryptionkey@0"
I20260811 02:36:32.580925 21166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:32.590365 21166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:32.592391 21166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:32.592552 21166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:32.596807 21166 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45865
I20260811 02:36:32.596840 21293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45865 every 8 connection(s)
I20260811 02:36:32.597198 21166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:32.597774 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21166
I20260811 02:36:32.597889 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:32.598155 17724 external_mini_cluster.cc:1428] Setting key e427eb0bb1efa4d4111830e1c850c6a2
I20260811 02:36:32.598385 21296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:32.601985 21296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf: Bootstrap starting.
I20260811 02:36:32.602766 21296 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:32.603101 21296 log.cc:824] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:32.603924 21296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf: No bootstrap required, opened a new log
Aug 11 02:36:32 dist-test-slave-7nm7 krb5kdc[21139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 02:36:32.606320 21296 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc14a46d99e44e0845d67cee7efdedf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45865 } }
I20260811 02:36:32.606515 21296 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:32.606578 21296 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc14a46d99e44e0845d67cee7efdedf, State: Initialized, Role: FOLLOWER
I20260811 02:36:32.606750 21296 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc14a46d99e44e0845d67cee7efdedf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45865 } }
I20260811 02:36:32.606827 21296 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:32.606853 21296 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:32.606928 21296 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:32.607674 21296 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc14a46d99e44e0845d67cee7efdedf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45865 } }
I20260811 02:36:32.607790 21296 leader_election.cc:302] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dc14a46d99e44e0845d67cee7efdedf; no voters:
I20260811 02:36:32.608016 21296 leader_election.cc:288] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:32.608062 21307 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:32.608238 21307 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [term 1 LEADER]: Becoming Leader. State: Replica: 8dc14a46d99e44e0845d67cee7efdedf, State: Running, Role: LEADER
I20260811 02:36:32.608340 21296 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:32.608438 21307 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc14a46d99e44e0845d67cee7efdedf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45865 } }
I20260811 02:36:32.609030 21308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dc14a46d99e44e0845d67cee7efdedf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc14a46d99e44e0845d67cee7efdedf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45865 } } }
I20260811 02:36:32.609131 21308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:32.609349 21314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:32.610129 21307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dc14a46d99e44e0845d67cee7efdedf. Latest consensus state: current_term: 1 leader_uuid: "8dc14a46d99e44e0845d67cee7efdedf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dc14a46d99e44e0845d67cee7efdedf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45865 } } }
I20260811 02:36:32.610181 21303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:32.598777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48171 (local address 127.0.0.1:45865)
0811 02:36:32.598960 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:32.598969 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:32.599003 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:36:32.599574 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:32.599582 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:32.599629 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:32.599752 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:32.600661 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:32.601542 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:32.602641 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:32.603098 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:32.603203 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:32.605999 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:32.606010 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:32.606010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:32.606021 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:32.608160 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:32.608677 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:32.608680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:32.608681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:32.608792 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:32.609066 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:32.609067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:32.609067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:32.609442 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:32.609763 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:32.609850 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 02:36:32.609952 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260811 02:36:32.610769 21307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:32.610913 21314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:32.612499 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:32.614355 21314 catalog_manager.cc:1347] Generated new cluster ID: 726b9a1adf1a4f39bc7bcfe12fc75baa
I20260811 02:36:32.614415 21314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:32.624472 21303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:32.613801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45931 (local address 127.0.0.1:45865)
0811 02:36:32.613835 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:32.613837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:32.618442 (+ 4605us) server_negotiation.cc:407] Connection header received
0811 02:36:32.618517 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:32.618518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:32.618528 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:32.618585 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:32.619111 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:32.619590 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:32.620339 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:32.620575 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:32.620666 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:32.621851 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:32.621853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:32.621853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:32.621861 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:32.623302 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:32.623670 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:32.623671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:32.623672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:32.623733 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:32.623960 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:32.623961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:32.623962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:32.624073 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:32.624184 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:32.624299 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 02:36:32.624366 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:36:32.635402 21314 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:32.636118 21314 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:32.652326 21314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8dc14a46d99e44e0845d67cee7efdedf: Generated new TSK 0
I20260811 02:36:32.652562 21314 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:32.662101 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21166
W20260811 02:36:32.679873 21137 connection.cc:535] client connection to 127.0.0.1:45865 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45865): Connection reset by peer (error 104)
2026-08-11T02:36:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1600 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:32 dist-test-slave-7nm7 krb5kdc[21352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:32 dist-test-slave-7nm7 krb5kdc[21352](info): set up 2 sockets
Aug 11 02:36:32 dist-test-slave-7nm7 krb5kdc[21352](info): commencing operation
krb5kdc: starting...
W20260811 02:36:33.948122 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:34 dist-test-slave-7nm7 krb5kdc[21352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:34.070997 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39515
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:34.153465 21382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:34.153674 21382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:34.153697 21382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:34.154769 21382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:34.154805 21382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:34.154819 21382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:34.154831 21382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:34.154844 21382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:34.156222 21382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39515
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:34.156414 21382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:34.156582 21382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:34.161805 21392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:34.161825 21388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:34.161931 21382 server_base.cc:1034] running on GCE node
W20260811 02:36:34.161990 21387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:34.162267 21382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:34.162632 21382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:34.163789 21382 hybrid_clock.cc:648] HybridClock initialized: now 1786415794163779 us; error 28 us; skew 500 ppm
Aug 11 02:36:34 dist-test-slave-7nm7 krb5kdc[21352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415794, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:34.166426 21382 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:34.166874 21382 webserver.cc:460] Webserver started at http://127.0.0.1:39931/ using document root <none> and password file <none>
I20260811 02:36:34.167055 21382 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:34.167094 21382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:34.167204 21382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:34.168174 21382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "32734a2e291a4e8d9f17740353982d73"
format_stamp: "Formatted at 2026-08-11 02:36:34 on dist-test-slave-7nm7"
server_key: "23f83a8a9ff98613f29d5c6dea546b95"
server_key_iv: "b5a0e0ac41f84f375a3f70e4b59ab64d"
server_key_version: "encryptionkey@0"
I20260811 02:36:34.168469 21382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "32734a2e291a4e8d9f17740353982d73"
format_stamp: "Formatted at 2026-08-11 02:36:34 on dist-test-slave-7nm7"
server_key: "23f83a8a9ff98613f29d5c6dea546b95"
server_key_iv: "b5a0e0ac41f84f375a3f70e4b59ab64d"
server_key_version: "encryptionkey@0"
I20260811 02:36:34.169728 21382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:34.170451 21408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:34.170625 21382 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:34.170730 21382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "32734a2e291a4e8d9f17740353982d73"
format_stamp: "Formatted at 2026-08-11 02:36:34 on dist-test-slave-7nm7"
server_key: "23f83a8a9ff98613f29d5c6dea546b95"
server_key_iv: "b5a0e0ac41f84f375a3f70e4b59ab64d"
server_key_version: "encryptionkey@0"
I20260811 02:36:34.170812 21382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:34.181691 21382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:34.183524 21382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:34.183687 21382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:34.187935 21382 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39515
I20260811 02:36:34.188299 21502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39515 every 8 connection(s)
I20260811 02:36:34.188309 21382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:34.189098 21503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:34.191460 21503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73: Bootstrap starting.
I20260811 02:36:34.192080 21503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:34.192386 21503 log.cc:824] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:34.193133 21503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73: No bootstrap required, opened a new log
I20260811 02:36:34.194825 21503 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32734a2e291a4e8d9f17740353982d73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39515 } }
I20260811 02:36:34.194958 21503 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:34.194980 21503 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32734a2e291a4e8d9f17740353982d73, State: Initialized, Role: FOLLOWER
I20260811 02:36:34.195163 21503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32734a2e291a4e8d9f17740353982d73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39515 } }
I20260811 02:36:34.195246 21503 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:34.195297 21503 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:34.195348 21503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:34.195873 21503 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32734a2e291a4e8d9f17740353982d73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39515 } }
I20260811 02:36:34.195986 21503 leader_election.cc:302] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32734a2e291a4e8d9f17740353982d73; no voters:
I20260811 02:36:34.196187 21503 leader_election.cc:288] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:34.196228 21508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:34.196422 21508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [term 1 LEADER]: Becoming Leader. State: Replica: 32734a2e291a4e8d9f17740353982d73, State: Running, Role: LEADER
I20260811 02:36:34.196448 21503 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:34.196540 21508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32734a2e291a4e8d9f17740353982d73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39515 } }
I20260811 02:36:34.196574 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21382
I20260811 02:36:34.196671 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:34.196889 17724 external_mini_cluster.cc:1428] Setting key 09d210a0b5d3ac39d8b77647c07e41bf
I20260811 02:36:34.196907 21508 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32734a2e291a4e8d9f17740353982d73. Latest consensus state: current_term: 1 leader_uuid: "32734a2e291a4e8d9f17740353982d73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32734a2e291a4e8d9f17740353982d73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39515 } } }
I20260811 02:36:34.196974 21508 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:34.197060 21509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32734a2e291a4e8d9f17740353982d73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32734a2e291a4e8d9f17740353982d73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39515 } } }
I20260811 02:36:34.197278 21509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:34.198297 21520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:34.198803 21520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:34.200331 21520 catalog_manager.cc:1347] Generated new cluster ID: 8cde1386aa7c4d3b8f1ad1dbf3b7d3d8
I20260811 02:36:34.200383 21520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:34.202368 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:34.197550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54737 (local address 127.0.0.1:39515)
0811 02:36:34.197771 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:34.197782 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:34.197815 (+ 33us) server_negotiation.cc:407] Connection header received
0811 02:36:34.197934 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:34.197940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:34.197988 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:34.198150 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:34.198431 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:34.199430 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:34.200487 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:34.200882 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:34.201003 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:34.201706 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:34.201710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:34.201710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:34.201887 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:34.201915 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:34.201925 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:34.202019 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:34.202100 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 02:36:34.202127 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":111,"threads_started":1}
I20260811 02:36:34.203284 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:34.207787 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:34.204639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57985 (local address 127.0.0.1:39515)
0811 02:36:34.204680 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:34.204682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:34.204813 (+ 131us) server_negotiation.cc:407] Connection header received
0811 02:36:34.204884 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:34.204885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:34.204895 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:34.204939 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:34.205061 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:34.205772 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:34.206570 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:34.206803 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:34.206880 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:34.207532 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:34.207533 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:34.207534 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:34.207538 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:34.207552 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:34.207556 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:34.207611 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:34.207677 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 02:36:34.207690 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:36:34.242317 21520 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:34.243060 21520 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:34.246747 21520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32734a2e291a4e8d9f17740353982d73: Generated new TSK 0
I20260811 02:36:34.246938 21520 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:34.255302 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21382
W20260811 02:36:34.275875 21347 connection.cc:535] client connection to 127.0.0.1:39515 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39515): Connection reset by peer (error 104)
2026-08-11T02:36:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1595 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:34 dist-test-slave-7nm7 krb5kdc[21560](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:34 dist-test-slave-7nm7 krb5kdc[21560](info): set up 2 sockets
Aug 11 02:36:34 dist-test-slave-7nm7 krb5kdc[21560](info): commencing operation
krb5kdc: starting...
W20260811 02:36:35.580623 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:35 dist-test-slave-7nm7 krb5kdc[21560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:35.707151 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:35.791219 21584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:35.791458 21584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:35.791496 21584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:35.792649 21584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:35.792721 21584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:35.792747 21584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:35.792775 21584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:35.792807 21584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:35.794304 21584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43469
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:35.794593 21584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:35.794826 21584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:35.799810 21596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:35.799826 21593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:35.799844 21594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:35.800083 21584 server_base.cc:1034] running on GCE node
I20260811 02:36:35.800343 21584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:35.800661 21584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:35.801810 21584 hybrid_clock.cc:648] HybridClock initialized: now 1786415795801798 us; error 29 us; skew 500 ppm
Aug 11 02:36:35 dist-test-slave-7nm7 krb5kdc[21560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415795, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:35.804394 21584 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:35.804939 21584 webserver.cc:460] Webserver started at http://127.0.0.1:36107/ using document root <none> and password file <none>
I20260811 02:36:35.805142 21584 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:35.805188 21584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:35.805467 21584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:35.807061 21584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "9777c20f3dd84b5882158da61fd97fd6"
format_stamp: "Formatted at 2026-08-11 02:36:35 on dist-test-slave-7nm7"
server_key: "dcbe254c1373ba9528aaa7e8ae8d6e48"
server_key_iv: "1a443eacf78a5c57fc8be6f3df763f5a"
server_key_version: "encryptionkey@0"
I20260811 02:36:35.807396 21584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "9777c20f3dd84b5882158da61fd97fd6"
format_stamp: "Formatted at 2026-08-11 02:36:35 on dist-test-slave-7nm7"
server_key: "dcbe254c1373ba9528aaa7e8ae8d6e48"
server_key_iv: "1a443eacf78a5c57fc8be6f3df763f5a"
server_key_version: "encryptionkey@0"
I20260811 02:36:35.808740 21584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:36:35.809537 21610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:35.809762 21584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:35.809854 21584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "9777c20f3dd84b5882158da61fd97fd6"
format_stamp: "Formatted at 2026-08-11 02:36:35 on dist-test-slave-7nm7"
server_key: "dcbe254c1373ba9528aaa7e8ae8d6e48"
server_key_iv: "1a443eacf78a5c57fc8be6f3df763f5a"
server_key_version: "encryptionkey@0"
I20260811 02:36:35.809911 21584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:35.813241 21584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:35.815156 21584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:35.815270 21584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:35.819694 21584 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43469
I20260811 02:36:35.819772 21702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43469 every 8 connection(s)
I20260811 02:36:35.820133 21584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:35.821235 21703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:35.823055 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21584
I20260811 02:36:35.823163 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:35.823387 17724 external_mini_cluster.cc:1428] Setting key f6940f66395990bf02808dc284a74462
I20260811 02:36:35.824419 21703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6: Bootstrap starting.
I20260811 02:36:35.825174 21703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:35.825521 21703 log.cc:824] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:35.826201 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:35.823918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33095 (local address 127.0.0.1:43469)
0811 02:36:35.824198 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:35.824208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:35.824240 (+ 32us) server_negotiation.cc:407] Connection header received
0811 02:36:35.824852 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:35.824863 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:35.824910 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:35.825061 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:35.825773 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:35.825776 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:35.825777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:35.825781 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:35.825822 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:35.825832 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:35.825935 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:35.826003 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 02:36:35.826046 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":69,"threads_started":1}
I20260811 02:36:35.826364 21703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6: No bootstrap required, opened a new log
I20260811 02:36:35.827291 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:35.828449 21703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9777c20f3dd84b5882158da61fd97fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43469 } }
I20260811 02:36:35.828606 21703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:35.828692 21703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9777c20f3dd84b5882158da61fd97fd6, State: Initialized, Role: FOLLOWER
I20260811 02:36:35.828828 21703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9777c20f3dd84b5882158da61fd97fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43469 } }
I20260811 02:36:35.828930 21703 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:35.828971 21703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:35.829025 21703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:35.829805 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:35.828710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42111 (local address 127.0.0.1:43469)
0811 02:36:35.828752 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:35.828754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:35.828839 (+ 85us) server_negotiation.cc:407] Connection header received
0811 02:36:35.828912 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:35.828913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:35.828918 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:35.828984 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:35.829579 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:35.829580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:35.829581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:35.829585 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:35.829599 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:35.829603 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:35.829672 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:35.829709 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 02:36:35.829726 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:36:35.829804 21703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9777c20f3dd84b5882158da61fd97fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43469 } }
I20260811 02:36:35.829963 21703 leader_election.cc:302] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9777c20f3dd84b5882158da61fd97fd6; no voters:
I20260811 02:36:35.830127 21703 leader_election.cc:288] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:35.830190 21718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:35.830402 21718 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [term 1 LEADER]: Becoming Leader. State: Replica: 9777c20f3dd84b5882158da61fd97fd6, State: Running, Role: LEADER
I20260811 02:36:35.830433 21703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:35.830497 21718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9777c20f3dd84b5882158da61fd97fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43469 } }
I20260811 02:36:35.830796 21718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9777c20f3dd84b5882158da61fd97fd6. Latest consensus state: current_term: 1 leader_uuid: "9777c20f3dd84b5882158da61fd97fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9777c20f3dd84b5882158da61fd97fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43469 } } }
I20260811 02:36:35.830909 21718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:35.830890 21720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9777c20f3dd84b5882158da61fd97fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9777c20f3dd84b5882158da61fd97fd6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43469 } } }
I20260811 02:36:35.830971 21720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:35.831211 21732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:35.831801 21732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:35.833354 21732 catalog_manager.cc:1347] Generated new cluster ID: a6afde278e9347eba12f018cf6ef0331
I20260811 02:36:35.833406 21732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:35.836982 21732 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:35.837124 21732 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:35.840631 21732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9777c20f3dd84b5882158da61fd97fd6: Generated new TSK 0
I20260811 02:36:35.840801 21732 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:35.846030 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21584
2026-08-11T02:36:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1584 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:35 dist-test-slave-7nm7 krb5kdc[21762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:35 dist-test-slave-7nm7 krb5kdc[21762](info): set up 2 sockets
Aug 11 02:36:35 dist-test-slave-7nm7 krb5kdc[21762](info): commencing operation
krb5kdc: starting...
W20260811 02:36:37.129925 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:37 dist-test-slave-7nm7 krb5kdc[21762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:37.254192 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42197
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:37.339901 21790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:37.340147 21790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:37.340173 21790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:37.341357 21790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:37.341411 21790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:37.341428 21790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:37.341444 21790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:37.341457 21790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:37.343137 21790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:37.343425 21790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:37.343677 21790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:37.349296 21804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:37.349458 21800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:37.349579 21790 server_base.cc:1034] running on GCE node
W20260811 02:36:37.349656 21799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:37.350147 21790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:37.350528 21790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:37.351722 21790 hybrid_clock.cc:648] HybridClock initialized: now 1786415797351722 us; error 42 us; skew 500 ppm
Aug 11 02:36:37 dist-test-slave-7nm7 krb5kdc[21762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415797, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:37.359041 21790 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:37.359560 21790 webserver.cc:460] Webserver started at http://127.0.0.1:40783/ using document root <none> and password file <none>
I20260811 02:36:37.359846 21790 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:37.359920 21790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:37.360088 21790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:37.361223 21790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "3b813ee2df2f48bda5374766b5cdf21b"
format_stamp: "Formatted at 2026-08-11 02:36:37 on dist-test-slave-7nm7"
server_key: "996861238805da37077d6341b8cbe0cd"
server_key_iv: "866f10e61b1b3ca5a1126e1fe2e10c63"
server_key_version: "encryptionkey@0"
I20260811 02:36:37.361604 21790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "3b813ee2df2f48bda5374766b5cdf21b"
format_stamp: "Formatted at 2026-08-11 02:36:37 on dist-test-slave-7nm7"
server_key: "996861238805da37077d6341b8cbe0cd"
server_key_iv: "866f10e61b1b3ca5a1126e1fe2e10c63"
server_key_version: "encryptionkey@0"
I20260811 02:36:37.363109 21790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:37.363942 21814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:37.364238 21790 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:37.364374 21790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "3b813ee2df2f48bda5374766b5cdf21b"
format_stamp: "Formatted at 2026-08-11 02:36:37 on dist-test-slave-7nm7"
server_key: "996861238805da37077d6341b8cbe0cd"
server_key_iv: "866f10e61b1b3ca5a1126e1fe2e10c63"
server_key_version: "encryptionkey@0"
I20260811 02:36:37.364454 21790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:37.378103 21790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:37.380146 21790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:37.380316 21790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:37.384491 21790 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42197
I20260811 02:36:37.384546 21907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42197 every 8 connection(s)
I20260811 02:36:37.384940 21790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:37.385923 21908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:37.388360 21908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b: Bootstrap starting.
I20260811 02:36:37.388931 21908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:37.389176 21908 log.cc:824] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:37.389879 21908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b: No bootstrap required, opened a new log
I20260811 02:36:37.390280 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21790
I20260811 02:36:37.390403 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:37.390587 17724 external_mini_cluster.cc:1428] Setting key b3424b09a22ff01d2d57496b92e1cae7
I20260811 02:36:37.392076 21908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b813ee2df2f48bda5374766b5cdf21b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260811 02:36:37.392212 21908 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:37.392236 21908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b813ee2df2f48bda5374766b5cdf21b, State: Initialized, Role: FOLLOWER
I20260811 02:36:37.392372 21908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b813ee2df2f48bda5374766b5cdf21b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260811 02:36:37.392460 21908 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:37.392498 21908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:37.392607 21908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:37.393734 21908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b813ee2df2f48bda5374766b5cdf21b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260811 02:36:37.393862 21908 leader_election.cc:302] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b813ee2df2f48bda5374766b5cdf21b; no voters:
I20260811 02:36:37.394083 21908 leader_election.cc:288] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:37.394115 21918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:37.394266 21918 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [term 1 LEADER]: Becoming Leader. State: Replica: 3b813ee2df2f48bda5374766b5cdf21b, State: Running, Role: LEADER
I20260811 02:36:37.394385 21908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:37.394408 21918 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b813ee2df2f48bda5374766b5cdf21b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } }
I20260811 02:36:37.394764 21918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b813ee2df2f48bda5374766b5cdf21b. Latest consensus state: current_term: 1 leader_uuid: "3b813ee2df2f48bda5374766b5cdf21b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b813ee2df2f48bda5374766b5cdf21b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } } }
I20260811 02:36:37.394776 21919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b813ee2df2f48bda5374766b5cdf21b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b813ee2df2f48bda5374766b5cdf21b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42197 } } }
I20260811 02:36:37.394994 21919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:37.394923 21918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:37.395308 21927 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:37.395921 21927 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:37.397595 21927 catalog_manager.cc:1347] Generated new cluster ID: c95afc0217d14ab3a5cadc3bec011917
I20260811 02:36:37.397651 21927 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:36:37 dist-test-slave-7nm7 krb5kdc[21762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 02:36:37.403980 21915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:37.391122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33005 (local address 127.0.0.1:42197)
0811 02:36:37.391319 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:37.391327 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:37.391353 (+ 26us) server_negotiation.cc:407] Connection header received
0811 02:36:37.392154 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:37.392170 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:37.392254 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:37.392435 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:37.393736 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:37.395268 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:37.396473 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:37.397065 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:37.397175 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:37.400149 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:37.400154 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:37.400154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:37.400167 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:37.402185 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:37.402642 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:37.402646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:37.402646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:37.402769 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:37.402971 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:37.402972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:37.402972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:37.403321 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:37.403511 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:37.403599 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 02:36:37.403770 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260811 02:36:37.405234 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:37.413337 21927 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:37.413838 21927 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:37.414425 21915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:37.406720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47113 (local address 127.0.0.1:42197)
0811 02:36:37.406756 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:37.406758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:37.406923 (+ 165us) server_negotiation.cc:407] Connection header received
0811 02:36:37.407018 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:37.407019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:37.407039 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:37.407068 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:37.407804 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:37.408545 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:37.409588 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:37.409897 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:37.409939 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:37.411482 (+ 1543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:37.411483 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:37.411483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:37.411490 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:37.413040 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:37.413517 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:37.413518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:37.413518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:37.413575 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:37.413771 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:37.413772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:37.413772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:37.413894 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:37.413964 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:37.414163 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 02:36:37.414331 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 02:36:37.420302 21927 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b813ee2df2f48bda5374766b5cdf21b: Generated new TSK 0
I20260811 02:36:37.420504 21927 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:37.427165 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21790
2026-08-11T02:36:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1582 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:37 dist-test-slave-7nm7 krb5kdc[21960](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:37 dist-test-slave-7nm7 krb5kdc[21960](info): set up 2 sockets
Aug 11 02:36:37 dist-test-slave-7nm7 krb5kdc[21960](info): commencing operation
krb5kdc: starting...
W20260811 02:36:38.743822 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:38 dist-test-slave-7nm7 krb5kdc[21960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:38.859067 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32831
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:38.939615 21982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:38.939877 21982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:38.939916 21982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:38.941076 21982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:38.941155 21982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:38.941182 21982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:38.941215 21982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:38.941239 21982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:38.942813 21982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:38.943112 21982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:38.943346 21982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:38.948413 21993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:38.948455 21991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:38.948544 21982 server_base.cc:1034] running on GCE node
W20260811 02:36:38.948413 21999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:38.948994 21982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:38.949298 21982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:38.950480 21982 hybrid_clock.cc:648] HybridClock initialized: now 1786415798950455 us; error 41 us; skew 500 ppm
Aug 11 02:36:38 dist-test-slave-7nm7 krb5kdc[21960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415798, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:38.953059 21982 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:38.953579 21982 webserver.cc:460] Webserver started at http://127.0.0.1:33311/ using document root <none> and password file <none>
I20260811 02:36:38.953821 21982 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:38.953891 21982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:38.954048 21982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:38.955164 21982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "94b798c3853e44048e5e7824ad263fd4"
format_stamp: "Formatted at 2026-08-11 02:36:38 on dist-test-slave-7nm7"
server_key: "a1a65cbf0120a156d48648c1957a193f"
server_key_iv: "678ab8709011cf0dced91145fa87bc7c"
server_key_version: "encryptionkey@0"
I20260811 02:36:38.955540 21982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "94b798c3853e44048e5e7824ad263fd4"
format_stamp: "Formatted at 2026-08-11 02:36:38 on dist-test-slave-7nm7"
server_key: "a1a65cbf0120a156d48648c1957a193f"
server_key_iv: "678ab8709011cf0dced91145fa87bc7c"
server_key_version: "encryptionkey@0"
I20260811 02:36:38.956889 21982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:38.957692 22014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:38.957893 21982 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:38.957998 21982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "94b798c3853e44048e5e7824ad263fd4"
format_stamp: "Formatted at 2026-08-11 02:36:38 on dist-test-slave-7nm7"
server_key: "a1a65cbf0120a156d48648c1957a193f"
server_key_iv: "678ab8709011cf0dced91145fa87bc7c"
server_key_version: "encryptionkey@0"
I20260811 02:36:38.958082 21982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:38.967592 21982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:38.969645 21982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:38.969821 21982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:38.974476 21982 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32831
I20260811 02:36:38.974509 22105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32831 every 8 connection(s)
I20260811 02:36:38.974890 21982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:38.975797 22108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:38.978072 22108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4: Bootstrap starting.
I20260811 02:36:38.978717 22108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:38.978952 22108 log.cc:824] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:38.979663 22108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4: No bootstrap required, opened a new log
I20260811 02:36:38.981210 22108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b798c3853e44048e5e7824ad263fd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32831 } }
I20260811 02:36:38.981348 22108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:38.981370 22108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94b798c3853e44048e5e7824ad263fd4, State: Initialized, Role: FOLLOWER
I20260811 02:36:38.981472 22108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b798c3853e44048e5e7824ad263fd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32831 } }
I20260811 02:36:38.981525 22108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:38.981545 22108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:38.981617 22108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:38.982156 22108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b798c3853e44048e5e7824ad263fd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32831 } }
I20260811 02:36:38.982299 22108 leader_election.cc:302] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94b798c3853e44048e5e7824ad263fd4; no voters:
I20260811 02:36:38.982497 22108 leader_election.cc:288] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:38.982589 22115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:38.982758 22115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [term 1 LEADER]: Becoming Leader. State: Replica: 94b798c3853e44048e5e7824ad263fd4, State: Running, Role: LEADER
I20260811 02:36:38.982777 22108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:38.982849 22115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b798c3853e44048e5e7824ad263fd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32831 } }
I20260811 02:36:38.983580 22118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94b798c3853e44048e5e7824ad263fd4. Latest consensus state: current_term: 1 leader_uuid: "94b798c3853e44048e5e7824ad263fd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b798c3853e44048e5e7824ad263fd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32831 } } }
I20260811 02:36:38.983690 22118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:38.983685 22116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94b798c3853e44048e5e7824ad263fd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94b798c3853e44048e5e7824ad263fd4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32831 } } }
I20260811 02:36:38.983850 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 21982
I20260811 02:36:38.983887 22116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:38.983959 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:38.984169 17724 external_mini_cluster.cc:1428] Setting key 8b8c76952b0a8b7cfeac62ebbf503315
I20260811 02:36:38.984470 22125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:38.985090 22125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:38.986783 22125 catalog_manager.cc:1347] Generated new cluster ID: 296dba89ef6c46c9bd6910ceee40834d
I20260811 02:36:38.986842 22125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:38.991364 22146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:38.984730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60929 (local address 127.0.0.1:32831)
0811 02:36:38.985791 (+ 1061us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:38.985799 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:38.985827 (+ 28us) server_negotiation.cc:407] Connection header received
0811 02:36:38.985914 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:38.985920 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:38.985962 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:38.986120 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:38.986365 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:38.987751 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:38.988841 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:38.989424 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:38.989831 (+ 407us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:38.990324 (+ 493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:38.990327 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:38.990328 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:38.990538 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:38.990574 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:38.990587 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:38.990876 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:38.990909 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 02:36:38.990968 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1004,"thread_start_us":98,"threads_started":1}
I20260811 02:36:38.992389 22125 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:38.992668 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:38.993024 22125 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:38.997179 22146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:38.994060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45173 (local address 127.0.0.1:32831)
0811 02:36:38.994098 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:38.994100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:38.994426 (+ 326us) server_negotiation.cc:407] Connection header received
0811 02:36:38.994497 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:38.994498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:38.994512 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:38.994571 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:38.994719 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:38.995200 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:38.995935 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:38.996159 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:38.996231 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:38.996899 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:38.996900 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:38.996900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:38.996904 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:38.996917 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:38.996921 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:38.996988 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:38.997049 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 02:36:38.997074 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:36:39.006704 22125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94b798c3853e44048e5e7824ad263fd4: Generated new TSK 0
I20260811 02:36:39.006927 22125 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:39.012018 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 21982
2026-08-11T02:36:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1588 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:39 dist-test-slave-7nm7 krb5kdc[22161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:39 dist-test-slave-7nm7 krb5kdc[22161](info): set up 2 sockets
Aug 11 02:36:39 dist-test-slave-7nm7 krb5kdc[22161](info): commencing operation
krb5kdc: starting...
W20260811 02:36:40.311192 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:40 dist-test-slave-7nm7 krb5kdc[22161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:40.437232 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41907
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:40.533116 22187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:40.533376 22187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:40.533416 22187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:40.534624 22187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:40.534690 22187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:40.534718 22187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:40.534751 22187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:40.534777 22187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:40.536279 22187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:40.536557 22187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:40.536798 22187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:40.541932 22196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:40.541985 22195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:40.542199 22187 server_base.cc:1034] running on GCE node
W20260811 02:36:40.541952 22198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:40.542510 22187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:40.542819 22187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:40.543974 22187 hybrid_clock.cc:648] HybridClock initialized: now 1786415800543956 us; error 37 us; skew 500 ppm
Aug 11 02:36:40 dist-test-slave-7nm7 krb5kdc[22161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415800, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:40.546823 22187 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:40.547310 22187 webserver.cc:460] Webserver started at http://127.0.0.1:42581/ using document root <none> and password file <none>
I20260811 02:36:40.547501 22187 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:40.547544 22187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:40.547636 22187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:40.548698 22187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "fb10383f2a474f78928876d6c7dd512a"
format_stamp: "Formatted at 2026-08-11 02:36:40 on dist-test-slave-7nm7"
server_key: "3584abb8ae7adba3d3ef7414077a4f2d"
server_key_iv: "25f097f675c7de1c3c5a09fe0ca5741d"
server_key_version: "encryptionkey@0"
I20260811 02:36:40.549008 22187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "fb10383f2a474f78928876d6c7dd512a"
format_stamp: "Formatted at 2026-08-11 02:36:40 on dist-test-slave-7nm7"
server_key: "3584abb8ae7adba3d3ef7414077a4f2d"
server_key_iv: "25f097f675c7de1c3c5a09fe0ca5741d"
server_key_version: "encryptionkey@0"
I20260811 02:36:40.550483 22187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:40.551368 22205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:40.551596 22187 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:40.551717 22187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "fb10383f2a474f78928876d6c7dd512a"
format_stamp: "Formatted at 2026-08-11 02:36:40 on dist-test-slave-7nm7"
server_key: "3584abb8ae7adba3d3ef7414077a4f2d"
server_key_iv: "25f097f675c7de1c3c5a09fe0ca5741d"
server_key_version: "encryptionkey@0"
I20260811 02:36:40.551805 22187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:40.555572 22187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:40.557933 22187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:40.558099 22187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:40.562384 22187 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41907
I20260811 02:36:40.562422 22305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41907 every 8 connection(s)
I20260811 02:36:40.562778 22187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:40.563392 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22187
I20260811 02:36:40.563524 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:40.563709 17724 external_mini_cluster.cc:1428] Setting key 1fae81928450f189f9c55e3e2d506507
I20260811 02:36:40.563928 22306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:40.566816 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:40.564629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49611 (local address 127.0.0.1:41907)
0811 02:36:40.564848 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:40.564857 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:40.564892 (+ 35us) server_negotiation.cc:407] Connection header received
0811 02:36:40.565474 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:40.565481 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:40.565505 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:40.565620 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:40.566326 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:40.566330 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:40.566330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:40.566335 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:40.566388 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:40.566399 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:40.566469 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:40.566562 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 02:36:40.566620 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":127,"threads_started":1}
I20260811 02:36:40.567464 22306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a: Bootstrap starting.
I20260811 02:36:40.568192 22306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:40.568325 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:40.568527 22306 log.cc:824] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:40.569249 22306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a: No bootstrap required, opened a new log
I20260811 02:36:40.570956 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:40.570027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43543 (local address 127.0.0.1:41907)
0811 02:36:40.570065 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:40.570067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:40.570108 (+ 41us) server_negotiation.cc:407] Connection header received
0811 02:36:40.570180 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:40.570180 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:40.570184 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:40.570266 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:40.570778 (+ 512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:40.570780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:40.570780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:40.570783 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:40.570795 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:40.570799 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:40.570840 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:40.570904 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 02:36:40.570914 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:36:40.571758 22306 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb10383f2a474f78928876d6c7dd512a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41907 } }
I20260811 02:36:40.571915 22306 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:40.571961 22306 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb10383f2a474f78928876d6c7dd512a, State: Initialized, Role: FOLLOWER
I20260811 02:36:40.572091 22306 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb10383f2a474f78928876d6c7dd512a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41907 } }
I20260811 02:36:40.572192 22306 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:40.572237 22306 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:40.572288 22306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:40.572837 22306 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb10383f2a474f78928876d6c7dd512a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41907 } }
I20260811 02:36:40.572959 22306 leader_election.cc:302] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb10383f2a474f78928876d6c7dd512a; no voters:
I20260811 02:36:40.573148 22306 leader_election.cc:288] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:40.573185 22327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:40.573403 22306 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:40.573472 22327 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [term 1 LEADER]: Becoming Leader. State: Replica: fb10383f2a474f78928876d6c7dd512a, State: Running, Role: LEADER
I20260811 02:36:40.573575 22327 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb10383f2a474f78928876d6c7dd512a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41907 } }
I20260811 02:36:40.573896 22327 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb10383f2a474f78928876d6c7dd512a. Latest consensus state: current_term: 1 leader_uuid: "fb10383f2a474f78928876d6c7dd512a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb10383f2a474f78928876d6c7dd512a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41907 } } }
I20260811 02:36:40.573908 22330 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb10383f2a474f78928876d6c7dd512a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb10383f2a474f78928876d6c7dd512a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41907 } } }
I20260811 02:36:40.573987 22327 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:40.573989 22330 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:40.574606 22340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:40.575337 22340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:40.577023 22340 catalog_manager.cc:1347] Generated new cluster ID: d1b0045398af4d64b0c7b571d92ac4e7
I20260811 02:36:40.577081 22340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:40.602514 22340 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:40.602725 22340 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:40.609283 22340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb10383f2a474f78928876d6c7dd512a: Generated new TSK 0
I20260811 02:36:40.609498 22340 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:40.618331 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22187
2026-08-11T02:36:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1606 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:40 dist-test-slave-7nm7 krb5kdc[22363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:40 dist-test-slave-7nm7 krb5kdc[22363](info): set up 2 sockets
Aug 11 02:36:40 dist-test-slave-7nm7 krb5kdc[22363](info): commencing operation
krb5kdc: starting...
W20260811 02:36:41.917172 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:42 dist-test-slave-7nm7 krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:42.041528 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39057
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:42.127910 22392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:42.128155 22392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:42.128194 22392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:42.129338 22392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:42.129408 22392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:42.129433 22392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:42.129460 22392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:42.129492 22392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:42.131001 22392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:42.131287 22392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:42.131522 22392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:42.136528 22399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:42.136518 22402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:42.136663 22392 server_base.cc:1034] running on GCE node
W20260811 02:36:42.136518 22398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:42.137486 22392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:42.137845 22392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:42.139046 22392 hybrid_clock.cc:648] HybridClock initialized: now 1786415802138994 us; error 84 us; skew 500 ppm
Aug 11 02:36:42 dist-test-slave-7nm7 krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415802, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:42.141690 22392 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:42.142138 22392 webserver.cc:460] Webserver started at http://127.0.0.1:45935/ using document root <none> and password file <none>
I20260811 02:36:42.142450 22392 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:42.142525 22392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:42.142685 22392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:42.143780 22392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "a2de99af26494107a958c2f236a6b4ea"
format_stamp: "Formatted at 2026-08-11 02:36:42 on dist-test-slave-7nm7"
server_key: "1830fdf39166a9dbbd25177b0e3bbba1"
server_key_iv: "5cc628044cc0e8e8ae3e1e9fc3f5772c"
server_key_version: "encryptionkey@0"
I20260811 02:36:42.144150 22392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "a2de99af26494107a958c2f236a6b4ea"
format_stamp: "Formatted at 2026-08-11 02:36:42 on dist-test-slave-7nm7"
server_key: "1830fdf39166a9dbbd25177b0e3bbba1"
server_key_iv: "5cc628044cc0e8e8ae3e1e9fc3f5772c"
server_key_version: "encryptionkey@0"
I20260811 02:36:42.145538 22392 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:36:42.146334 22410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:42.146513 22392 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:42.146622 22392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "a2de99af26494107a958c2f236a6b4ea"
format_stamp: "Formatted at 2026-08-11 02:36:42 on dist-test-slave-7nm7"
server_key: "1830fdf39166a9dbbd25177b0e3bbba1"
server_key_iv: "5cc628044cc0e8e8ae3e1e9fc3f5772c"
server_key_version: "encryptionkey@0"
I20260811 02:36:42.146715 22392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:42.161670 22392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:42.164992 22392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:42.165203 22392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:42.169981 22392 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39057
I20260811 02:36:42.170013 22506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39057 every 8 connection(s)
I20260811 02:36:42.170403 22392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:42.171387 22507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:42.173663 22507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea: Bootstrap starting.
I20260811 02:36:42.174218 22507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:42.174477 22507 log.cc:824] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:42.175173 22507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea: No bootstrap required, opened a new log
I20260811 02:36:42.176714 22507 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2de99af26494107a958c2f236a6b4ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260811 02:36:42.176851 22507 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:42.176873 22507 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2de99af26494107a958c2f236a6b4ea, State: Initialized, Role: FOLLOWER
I20260811 02:36:42.177016 22507 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2de99af26494107a958c2f236a6b4ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260811 02:36:42.177098 22507 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:42.177121 22507 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:42.177150 22507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:42.177626 22507 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2de99af26494107a958c2f236a6b4ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260811 02:36:42.177719 22507 leader_election.cc:302] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2de99af26494107a958c2f236a6b4ea; no voters:
I20260811 02:36:42.177845 22507 leader_election.cc:288] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:42.177923 22514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:42.178133 22507 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:42.178149 22514 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [term 1 LEADER]: Becoming Leader. State: Replica: a2de99af26494107a958c2f236a6b4ea, State: Running, Role: LEADER
I20260811 02:36:42.178344 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22392
I20260811 02:36:42.178364 22514 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2de99af26494107a958c2f236a6b4ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } }
I20260811 02:36:42.178472 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:42.178709 17724 external_mini_cluster.cc:1428] Setting key 321ad7d9bb4c83f1970f3d512411918b
I20260811 02:36:42.178927 22515 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2de99af26494107a958c2f236a6b4ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2de99af26494107a958c2f236a6b4ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } } }
I20260811 02:36:42.179134 22515 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:42.179071 22519 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2de99af26494107a958c2f236a6b4ea. Latest consensus state: current_term: 1 leader_uuid: "a2de99af26494107a958c2f236a6b4ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2de99af26494107a958c2f236a6b4ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39057 } } }
I20260811 02:36:42.179335 22519 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:42.179510 22529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:42.180073 22529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:42.181943 22529 catalog_manager.cc:1347] Generated new cluster ID: c07d3927b6dd468899160bcf0802b893
I20260811 02:36:42.181998 22529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:36:42 dist-test-slave-7nm7 krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 02:36:42.189795 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:42.179608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:51805 (local address 127.0.0.1:39057)
0811 02:36:42.179772 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:42.179784 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:42.179818 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:36:42.179934 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:42.179942 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:42.180000 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:42.180139 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:42.181143 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:42.182474 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:42.183251 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:42.183677 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:42.183802 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:42.186204 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:42.186208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:42.186208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:42.186219 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:42.188156 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:42.188594 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:42.188599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:42.188599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:42.188700 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:42.188946 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:42.188947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:42.188948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:42.189197 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:42.189396 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:42.189483 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 02:36:42.189587 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
I20260811 02:36:42.190784 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:42.197284 22529 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:42.197978 22529 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:42.198750 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:42.192140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:35385 (local address 127.0.0.1:39057)
0811 02:36:42.192186 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:42.192188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:42.192314 (+ 126us) server_negotiation.cc:407] Connection header received
0811 02:36:42.192388 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:42.192389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:42.192399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:42.192447 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:42.192969 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:42.193486 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:42.194197 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:42.194482 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:42.194562 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:42.195871 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:42.195872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:42.195873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:42.195880 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:42.197528 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:42.197895 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:42.197896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:42.197897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:42.197953 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:42.198195 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:42.198195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:42.198195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:42.198337 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:42.198466 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:42.198580 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 02:36:42.198644 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:36:42.211534 22529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2de99af26494107a958c2f236a6b4ea: Generated new TSK 0
I20260811 02:36:42.211762 22529 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:42.216799 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22392
W20260811 02:36:42.236516 22359 connection.cc:535] client connection to 127.0.0.1:39057 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39057): Connection reset by peer (error 104)
2026-08-11T02:36:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1598 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:42 dist-test-slave-7nm7 krb5kdc[22571](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:42 dist-test-slave-7nm7 krb5kdc[22571](info): set up 2 sockets
Aug 11 02:36:42 dist-test-slave-7nm7 krb5kdc[22571](info): commencing operation
krb5kdc: starting...
W20260811 02:36:43.519596 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:43 dist-test-slave-7nm7 krb5kdc[22571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:43.650732 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43721
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:43.741760 22587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:43.741982 22587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:43.742007 22587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:43.743232 22587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:43.743279 22587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:43.743294 22587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:43.743307 22587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:43.743319 22587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:43.744848 22587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:43.745110 22587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:43.745348 22587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:43.750931 22594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:43.750910 22595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:43.750910 22598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:43.751945 22587 server_base.cc:1034] running on GCE node
I20260811 02:36:43.752256 22587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:43.752713 22587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:43.753927 22587 hybrid_clock.cc:648] HybridClock initialized: now 1786415803753914 us; error 45 us; skew 500 ppm
Aug 11 02:36:43 dist-test-slave-7nm7 krb5kdc[22571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415803, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:43.761107 22587 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:43.761636 22587 webserver.cc:460] Webserver started at http://127.0.0.1:33829/ using document root <none> and password file <none>
I20260811 02:36:43.761885 22587 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:43.761956 22587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:43.762115 22587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:43.763474 22587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "c3bef6ae75f04883bf27939626252ec7"
format_stamp: "Formatted at 2026-08-11 02:36:43 on dist-test-slave-7nm7"
server_key: "28ccad64846166f450f5d9f3cb8cafb6"
server_key_iv: "36da5fc5fea5b0ebe91ecb0a8bac6d3a"
server_key_version: "encryptionkey@0"
I20260811 02:36:43.763859 22587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "c3bef6ae75f04883bf27939626252ec7"
format_stamp: "Formatted at 2026-08-11 02:36:43 on dist-test-slave-7nm7"
server_key: "28ccad64846166f450f5d9f3cb8cafb6"
server_key_iv: "36da5fc5fea5b0ebe91ecb0a8bac6d3a"
server_key_version: "encryptionkey@0"
I20260811 02:36:43.765355 22587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 02:36:43.766340 22607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:43.766582 22587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:43.766695 22587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "c3bef6ae75f04883bf27939626252ec7"
format_stamp: "Formatted at 2026-08-11 02:36:43 on dist-test-slave-7nm7"
server_key: "28ccad64846166f450f5d9f3cb8cafb6"
server_key_iv: "36da5fc5fea5b0ebe91ecb0a8bac6d3a"
server_key_version: "encryptionkey@0"
I20260811 02:36:43.766783 22587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:43.783190 22587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:43.785596 22587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:43.785782 22587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:43.790112 22587 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43721
I20260811 02:36:43.790154 22704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43721 every 8 connection(s)
I20260811 02:36:43.790553 22587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:43.791502 22706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:43.793813 22706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7: Bootstrap starting.
I20260811 02:36:43.794476 22706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:43.794780 22706 log.cc:824] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:43.795506 22706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7: No bootstrap required, opened a new log
I20260811 02:36:43.797111 22706 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bef6ae75f04883bf27939626252ec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43721 } }
I20260811 02:36:43.797253 22706 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:43.797278 22706 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3bef6ae75f04883bf27939626252ec7, State: Initialized, Role: FOLLOWER
I20260811 02:36:43.797477 22706 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bef6ae75f04883bf27939626252ec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43721 } }
I20260811 02:36:43.797552 22706 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:43.797574 22706 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:43.797614 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22587
I20260811 02:36:43.797634 22706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:43.797755 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:43.797953 17724 external_mini_cluster.cc:1428] Setting key 02e6874eae4b4cde7adff3d9e1a6859c
I20260811 02:36:43.798384 22706 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bef6ae75f04883bf27939626252ec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43721 } }
I20260811 02:36:43.798509 22706 leader_election.cc:302] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3bef6ae75f04883bf27939626252ec7; no voters:
I20260811 02:36:43.798688 22706 leader_election.cc:288] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:43.798748 22712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:43.798938 22712 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [term 1 LEADER]: Becoming Leader. State: Replica: c3bef6ae75f04883bf27939626252ec7, State: Running, Role: LEADER
I20260811 02:36:43.798978 22706 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:43.799111 22712 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bef6ae75f04883bf27939626252ec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43721 } }
I20260811 02:36:43.799489 22714 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3bef6ae75f04883bf27939626252ec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bef6ae75f04883bf27939626252ec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43721 } } }
I20260811 02:36:43.799567 22714 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:43.799805 22718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:43.800287 22718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:43.801050 22715 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3bef6ae75f04883bf27939626252ec7. Latest consensus state: current_term: 1 leader_uuid: "c3bef6ae75f04883bf27939626252ec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3bef6ae75f04883bf27939626252ec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43721 } } }
I20260811 02:36:43.801187 22715 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:43.801797 22718 catalog_manager.cc:1347] Generated new cluster ID: f0c60ef1e2a24b1d94c3d51cda6a7901
I20260811 02:36:43.801854 22718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:43.804258 22713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:43.798581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:41017 (local address 127.0.0.1:43721)
0811 02:36:43.798859 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:43.798871 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:43.798910 (+ 39us) server_negotiation.cc:407] Connection header received
0811 02:36:43.799031 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:43.799038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:43.799098 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:43.799546 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:43.799629 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:43.801019 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:43.802108 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:43.802697 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:43.802790 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:43.803556 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:43.803560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:43.803560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:43.803775 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:43.803810 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:43.803823 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:43.803903 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:43.804032 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 02:36:43.804056 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":113,"threads_started":1}
I20260811 02:36:43.805187 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:43.810408 22713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:43.806694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:37635 (local address 127.0.0.1:43721)
0811 02:36:43.806769 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:43.806771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:43.806878 (+ 107us) server_negotiation.cc:407] Connection header received
0811 02:36:43.806907 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:43.806908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:43.806920 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:43.806985 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:43.807189 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:43.807952 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:43.808969 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:43.809313 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:43.809391 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:43.810070 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:43.810071 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:43.810072 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:43.810076 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:43.810091 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:43.810095 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:43.810162 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:43.810322 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 02:36:43.810333 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 02:36:43.815322 22718 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:43.815816 22718 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:43.821108 22718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3bef6ae75f04883bf27939626252ec7: Generated new TSK 0
I20260811 02:36:43.821293 22718 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:43.829268 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22587
W20260811 02:36:43.840771 22569 connection.cc:535] client connection to 127.0.0.1:43721 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43721): Connection reset by peer (error 104)
2026-08-11T02:36:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1603 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:43 dist-test-slave-7nm7 krb5kdc[22760](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:43 dist-test-slave-7nm7 krb5kdc[22760](info): set up 2 sockets
Aug 11 02:36:43 dist-test-slave-7nm7 krb5kdc[22760](info): commencing operation
krb5kdc: starting...
W20260811 02:36:45.165536 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:45 dist-test-slave-7nm7 krb5kdc[22760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:45.293797 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:45.379817 22783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:45.380076 22783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:45.380259 22783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:45.381656 22783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:45.381742 22783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:45.381770 22783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:45.381803 22783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:45.381827 22783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:45.383781 22783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:45.384088 22783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:45.384328 22783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:45.389799 22791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:45.389885 22794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:45.389803 22796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:45.390002 22783 server_base.cc:1034] running on GCE node
I20260811 02:36:45.390347 22783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:45.390708 22783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:45.391886 22783 hybrid_clock.cc:648] HybridClock initialized: now 1786415805391874 us; error 33 us; skew 500 ppm
Aug 11 02:36:45 dist-test-slave-7nm7 krb5kdc[22760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415805, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:45.395017 22783 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:45.395529 22783 webserver.cc:460] Webserver started at http://127.0.0.1:37637/ using document root <none> and password file <none>
I20260811 02:36:45.395804 22783 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:45.395879 22783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:45.396034 22783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:45.397138 22783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "5e53688526ed45a69efe3d468ac3f243"
format_stamp: "Formatted at 2026-08-11 02:36:45 on dist-test-slave-7nm7"
server_key: "ca960ae3b58eff8a7c88efe39ce614f8"
server_key_iv: "ee295021c4b22480c57974ad9511aa92"
server_key_version: "encryptionkey@0"
I20260811 02:36:45.397514 22783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "5e53688526ed45a69efe3d468ac3f243"
format_stamp: "Formatted at 2026-08-11 02:36:45 on dist-test-slave-7nm7"
server_key: "ca960ae3b58eff8a7c88efe39ce614f8"
server_key_iv: "ee295021c4b22480c57974ad9511aa92"
server_key_version: "encryptionkey@0"
I20260811 02:36:45.399039 22783 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:36:45.399919 22809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:45.400211 22783 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:45.400360 22783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "5e53688526ed45a69efe3d468ac3f243"
format_stamp: "Formatted at 2026-08-11 02:36:45 on dist-test-slave-7nm7"
server_key: "ca960ae3b58eff8a7c88efe39ce614f8"
server_key_iv: "ee295021c4b22480c57974ad9511aa92"
server_key_version: "encryptionkey@0"
I20260811 02:36:45.400452 22783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:45.404189 22783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:45.406412 22783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:45.406569 22783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:45.411000 22783 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38163
I20260811 02:36:45.411032 22898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38163 every 8 connection(s)
I20260811 02:36:45.411372 22783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:45.412442 22899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:45.415094 22899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243: Bootstrap starting.
I20260811 02:36:45.415700 22899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:45.415995 22899 log.cc:824] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:45.416764 22899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243: No bootstrap required, opened a new log
I20260811 02:36:45.418473 22899 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53688526ed45a69efe3d468ac3f243" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260811 02:36:45.418613 22899 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:45.418644 22899 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e53688526ed45a69efe3d468ac3f243, State: Initialized, Role: FOLLOWER
I20260811 02:36:45.418802 22899 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53688526ed45a69efe3d468ac3f243" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260811 02:36:45.418867 22899 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:45.418889 22899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:45.418943 22899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:45.419443 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22783
I20260811 02:36:45.419540 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:45.419798 17724 external_mini_cluster.cc:1428] Setting key e0bc20c99fa4d5a056a2c5c9b6cc3ed2
I20260811 02:36:45.419930 22899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53688526ed45a69efe3d468ac3f243" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260811 02:36:45.420065 22899 leader_election.cc:302] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e53688526ed45a69efe3d468ac3f243; no voters:
I20260811 02:36:45.420245 22899 leader_election.cc:288] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:45.420276 22906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:45.420506 22906 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [term 1 LEADER]: Becoming Leader. State: Replica: 5e53688526ed45a69efe3d468ac3f243, State: Running, Role: LEADER
I20260811 02:36:45.420624 22899 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:45.420650 22906 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53688526ed45a69efe3d468ac3f243" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } }
I20260811 02:36:45.421044 22910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e53688526ed45a69efe3d468ac3f243" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53688526ed45a69efe3d468ac3f243" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } } }
I20260811 02:36:45.421324 22910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:45.421231 22909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e53688526ed45a69efe3d468ac3f243. Latest consensus state: current_term: 1 leader_uuid: "5e53688526ed45a69efe3d468ac3f243" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53688526ed45a69efe3d468ac3f243" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38163 } } }
I20260811 02:36:45.421593 22909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:45.421675 22924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:45.422261 22924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:45.423830 22924 catalog_manager.cc:1347] Generated new cluster ID: 788bde95af7c445a94b3f896f9893110
I20260811 02:36:45.423893 22924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:45.435314 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:45.420326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:56423 (local address 127.0.0.1:38163)
0811 02:36:45.420543 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:45.420553 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:45.421142 (+ 589us) server_negotiation.cc:407] Connection header received
0811 02:36:45.421571 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:45.421580 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:45.421630 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:45.421750 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:45.434804 (+ 13054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:45.434810 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:45.434810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:45.434816 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:45.434875 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:45.434892 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:45.434975 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:45.435054 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 02:36:45.435108 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":110,"threads_started":1}
I20260811 02:36:45.436362 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:45.439182 22908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:45.437957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:60257 (local address 127.0.0.1:38163)
0811 02:36:45.438002 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:45.438004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:45.438172 (+ 168us) server_negotiation.cc:407] Connection header received
0811 02:36:45.438219 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:45.438220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:45.438275 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:45.438333 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:45.438973 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:45.438974 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:45.438975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:45.438979 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:45.438994 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:45.438998 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:45.439051 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:45.439106 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 02:36:45.439120 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:36:45.446983 22924 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:45.447165 22924 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:45.449841 22924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e53688526ed45a69efe3d468ac3f243: Generated new TSK 0
I20260811 02:36:45.450054 22924 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:45.455792 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22783
2026-08-11T02:36:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1645 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:45 dist-test-slave-7nm7 krb5kdc[22951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:45 dist-test-slave-7nm7 krb5kdc[22951](info): set up 2 sockets
Aug 11 02:36:45 dist-test-slave-7nm7 krb5kdc[22951](info): commencing operation
krb5kdc: starting...
W20260811 02:36:46.785312 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:46 dist-test-slave-7nm7 krb5kdc[22951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:46.913335 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41721
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:46.999979 22985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:47.000226 22985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:47.000264 22985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:47.001405 22985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:47.001471 22985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:47.001497 22985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:47.001526 22985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:47.001556 22985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:47.003054 22985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41721
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:47.003342 22985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:47.003566 22985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:47.008671 22994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:47.008667 22992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:47.008940 22985 server_base.cc:1034] running on GCE node
W20260811 02:36:47.008668 22996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:47.009231 22985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:47.009521 22985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:47.010694 22985 hybrid_clock.cc:648] HybridClock initialized: now 1786415807010668 us; error 37 us; skew 500 ppm
Aug 11 02:36:47 dist-test-slave-7nm7 krb5kdc[22951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415807, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:47.013355 22985 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:47.013808 22985 webserver.cc:460] Webserver started at http://127.0.0.1:33427/ using document root <none> and password file <none>
I20260811 02:36:47.014072 22985 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:47.014149 22985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:47.014325 22985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:47.015430 22985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "e8b575bbca3d466eb4f54766c761fc76"
format_stamp: "Formatted at 2026-08-11 02:36:47 on dist-test-slave-7nm7"
server_key: "e92a4195dd843de668185e78f5b6b7ec"
server_key_iv: "d630ec968126e6a3fb76eca95ce34285"
server_key_version: "encryptionkey@0"
I20260811 02:36:47.015818 22985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "e8b575bbca3d466eb4f54766c761fc76"
format_stamp: "Formatted at 2026-08-11 02:36:47 on dist-test-slave-7nm7"
server_key: "e92a4195dd843de668185e78f5b6b7ec"
server_key_iv: "d630ec968126e6a3fb76eca95ce34285"
server_key_version: "encryptionkey@0"
I20260811 02:36:47.017318 22985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:36:47.018216 23009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:47.018501 22985 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 02:36:47.018608 22985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "e8b575bbca3d466eb4f54766c761fc76"
format_stamp: "Formatted at 2026-08-11 02:36:47 on dist-test-slave-7nm7"
server_key: "e92a4195dd843de668185e78f5b6b7ec"
server_key_iv: "d630ec968126e6a3fb76eca95ce34285"
server_key_version: "encryptionkey@0"
I20260811 02:36:47.018699 22985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:47.031682 22985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:47.033552 22985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:47.033717 22985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:47.037943 22985 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41721
I20260811 02:36:47.037997 23096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41721 every 8 connection(s)
I20260811 02:36:47.038372 22985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:47.038872 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 22985
I20260811 02:36:47.039005 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:47.039178 17724 external_mini_cluster.cc:1428] Setting key c3006bbff7ae17cc42327452df9c9dc6
I20260811 02:36:47.039374 23097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:47.042706 23097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76: Bootstrap starting.
I20260811 02:36:47.043419 23097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:47.043716 23097 log.cc:824] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:47.044450 23097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76: No bootstrap required, opened a new log
Aug 11 02:36:47 dist-test-slave-7nm7 krb5kdc[22951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 02:36:47.046586 23097 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b575bbca3d466eb4f54766c761fc76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41721 } }
I20260811 02:36:47.046716 23097 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:47.046739 23097 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b575bbca3d466eb4f54766c761fc76, State: Initialized, Role: FOLLOWER
I20260811 02:36:47.046870 23097 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b575bbca3d466eb4f54766c761fc76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41721 } }
I20260811 02:36:47.046958 23097 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:47.047019 23097 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:47.047087 23097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:47.047781 23097 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b575bbca3d466eb4f54766c761fc76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41721 } }
I20260811 02:36:47.047910 23097 leader_election.cc:302] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8b575bbca3d466eb4f54766c761fc76; no voters:
I20260811 02:36:47.048079 23097 leader_election.cc:288] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:47.048120 23112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:47.048236 23112 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [term 1 LEADER]: Becoming Leader. State: Replica: e8b575bbca3d466eb4f54766c761fc76, State: Running, Role: LEADER
I20260811 02:36:47.048373 23112 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b575bbca3d466eb4f54766c761fc76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41721 } }
I20260811 02:36:47.048403 23097 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:47.049152 23116 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8b575bbca3d466eb4f54766c761fc76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b575bbca3d466eb4f54766c761fc76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41721 } } }
I20260811 02:36:47.049278 23116 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:47.049624 23115 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8b575bbca3d466eb4f54766c761fc76. Latest consensus state: current_term: 1 leader_uuid: "e8b575bbca3d466eb4f54766c761fc76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b575bbca3d466eb4f54766c761fc76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41721 } } }
I20260811 02:36:47.049701 23115 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76 [sys.catalog]: This master's current role is: LEADER
W20260811 02:36:47.050554 23143 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:36:47.050625 23143 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:36:47.050726 23128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:47.050892 23128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:47.051461 23105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:47.039727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:43179 (local address 127.0.0.1:41721)
0811 02:36:47.039918 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:47.039925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:47.039948 (+ 23us) server_negotiation.cc:407] Connection header received
0811 02:36:47.040472 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:47.040478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:47.040523 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:47.040631 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:47.041460 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:47.042437 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:47.043509 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:47.043947 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:47.044090 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:47.047014 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:47.047020 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:47.047020 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:47.047036 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:47.049240 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:47.049722 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:47.049724 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:47.049725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:47.049854 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:47.050223 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:47.050224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:47.050225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:47.050554 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:47.051057 (+ 503us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:47.051155 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 02:36:47.051256 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
I20260811 02:36:47.052470 23128 catalog_manager.cc:1347] Generated new cluster ID: ddd3b66343c740d1bd4e88234799443f
I20260811 02:36:47.052520 23128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:47.052523 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:47.061398 23105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:47.053931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:35319 (local address 127.0.0.1:41721)
0811 02:36:47.053969 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:47.053971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:47.054041 (+ 70us) server_negotiation.cc:407] Connection header received
0811 02:36:47.054083 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:47.054084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:47.054094 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:47.054168 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:47.054783 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:47.055809 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:47.056784 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:47.057117 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:47.057201 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:47.058536 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:47.058537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:47.058538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:47.058545 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:47.060151 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:47.060554 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:47.060555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:47.060555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:47.060618 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:47.060853 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:47.060854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:47.060854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:47.060982 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:47.061109 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:47.061241 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 02:36:47.061307 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:36:47.082007 23128 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:47.082830 23128 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:47.090425 23128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8b575bbca3d466eb4f54766c761fc76: Generated new TSK 0
I20260811 02:36:47.090611 23128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:47.093356 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 22985
W20260811 02:36:47.108259 22948 connection.cc:535] client connection to 127.0.0.1:41721 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41721): Connection reset by peer (error 104)
2026-08-11T02:36:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1621 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:47 dist-test-slave-7nm7 krb5kdc[23165](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:47 dist-test-slave-7nm7 krb5kdc[23165](info): set up 2 sockets
Aug 11 02:36:47 dist-test-slave-7nm7 krb5kdc[23165](info): commencing operation
krb5kdc: starting...
W20260811 02:36:48.406292 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:48 dist-test-slave-7nm7 krb5kdc[23165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:48.537362 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42619
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:48.619380 23190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:48.619617 23190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:48.619659 23190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:48.620798 23190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:48.620870 23190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:48.620900 23190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:48.620949 23190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:48.620983 23190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:48.622694 23190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42619
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:48.622967 23190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:48.623234 23190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:48.628242 23203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:48.628377 23190 server_base.cc:1034] running on GCE node
W20260811 02:36:48.628234 23197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:48.628312 23199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:48.628696 23190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:48.628985 23190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:48.630163 23190 hybrid_clock.cc:648] HybridClock initialized: now 1786415808630160 us; error 36 us; skew 500 ppm
Aug 11 02:36:48 dist-test-slave-7nm7 krb5kdc[23165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415808, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:48.632716 23190 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:48.633145 23190 webserver.cc:460] Webserver started at http://127.0.0.1:40567/ using document root <none> and password file <none>
I20260811 02:36:48.633394 23190 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:48.633464 23190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:48.633610 23190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:48.634694 23190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "a147743d92f243218af3c73d93317e60"
format_stamp: "Formatted at 2026-08-11 02:36:48 on dist-test-slave-7nm7"
server_key: "94d6944bd831d0b0d06ea546c27f76d3"
server_key_iv: "a5b6d5fa041dcac40c286386631f247f"
server_key_version: "encryptionkey@0"
I20260811 02:36:48.635047 23190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "a147743d92f243218af3c73d93317e60"
format_stamp: "Formatted at 2026-08-11 02:36:48 on dist-test-slave-7nm7"
server_key: "94d6944bd831d0b0d06ea546c27f76d3"
server_key_iv: "a5b6d5fa041dcac40c286386631f247f"
server_key_version: "encryptionkey@0"
I20260811 02:36:48.636426 23190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:48.637220 23212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:48.637418 23190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:48.637527 23190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "a147743d92f243218af3c73d93317e60"
format_stamp: "Formatted at 2026-08-11 02:36:48 on dist-test-slave-7nm7"
server_key: "94d6944bd831d0b0d06ea546c27f76d3"
server_key_iv: "a5b6d5fa041dcac40c286386631f247f"
server_key_version: "encryptionkey@0"
I20260811 02:36:48.637611 23190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:48.649595 23190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:48.651816 23190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:48.651975 23190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:48.656322 23190 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42619
I20260811 02:36:48.656353 23303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42619 every 8 connection(s)
I20260811 02:36:48.656684 23190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:48.657500 23304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:48.659726 23304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60: Bootstrap starting.
I20260811 02:36:48.660243 23304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:48.660481 23304 log.cc:824] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:48.661118 23304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60: No bootstrap required, opened a new log
I20260811 02:36:48.662387 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23190
I20260811 02:36:48.662506 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:48.662690 17724 external_mini_cluster.cc:1428] Setting key befcbe61f21bfa9afa448f6ce8555cf9
I20260811 02:36:48.663003 23304 raft_consensus.cc:348] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a147743d92f243218af3c73d93317e60" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42619 } }
I20260811 02:36:48.663194 23304 raft_consensus.cc:374] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:48.663245 23304 raft_consensus.cc:729] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a147743d92f243218af3c73d93317e60, State: Initialized, Role: FOLLOWER
I20260811 02:36:48.663421 23304 consensus_queue.cc:260] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a147743d92f243218af3c73d93317e60" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42619 } }
I20260811 02:36:48.663530 23304 raft_consensus.cc:388] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:48.663590 23304 raft_consensus.cc:482] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:48.663641 23304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:48.664628 23304 raft_consensus.cc:504] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a147743d92f243218af3c73d93317e60" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42619 } }
I20260811 02:36:48.664716 23304 leader_election.cc:302] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a147743d92f243218af3c73d93317e60; no voters:
I20260811 02:36:48.664909 23304 leader_election.cc:288] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:48.664932 23316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:48.665045 23316 raft_consensus.cc:686] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [term 1 LEADER]: Becoming Leader. State: Replica: a147743d92f243218af3c73d93317e60, State: Running, Role: LEADER
I20260811 02:36:48.665172 23304 sys_catalog.cc:564] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:48.665180 23316 consensus_queue.cc:237] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a147743d92f243218af3c73d93317e60" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42619 } }
I20260811 02:36:48.665623 23317 sys_catalog.cc:455] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a147743d92f243218af3c73d93317e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a147743d92f243218af3c73d93317e60" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42619 } } }
I20260811 02:36:48.665644 23318 sys_catalog.cc:455] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a147743d92f243218af3c73d93317e60. Latest consensus state: current_term: 1 leader_uuid: "a147743d92f243218af3c73d93317e60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a147743d92f243218af3c73d93317e60" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42619 } } }
I20260811 02:36:48.665815 23318 sys_catalog.cc:458] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:48.666025 23330 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:48.665736 23317 sys_catalog.cc:458] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:48.666597 23330 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:48.668509 23315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:48.663226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:53089 (local address 127.0.0.1:42619)
0811 02:36:48.663419 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:48.663428 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:48.663485 (+ 57us) server_negotiation.cc:407] Connection header received
0811 02:36:48.663612 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:48.663619 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:48.663678 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:48.663802 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:48.664062 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:48.665123 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:48.666291 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:48.666947 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:48.667403 (+ 456us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:48.667832 (+ 429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:48.667836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:48.667836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:48.668065 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:48.668103 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:48.668119 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:48.668204 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:48.668286 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 02:36:48.668314 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
I20260811 02:36:48.668934 23330 catalog_manager.cc:1347] Generated new cluster ID: 763092ed51a4489d8b5744fadc369bb3
I20260811 02:36:48.668982 23330 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:48.670799 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:48.675886 23315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:48.672418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:41029 (local address 127.0.0.1:42619)
0811 02:36:48.672475 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:48.672478 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:48.672523 (+ 45us) server_negotiation.cc:407] Connection header received
0811 02:36:48.672585 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:48.672586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:48.672608 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:48.672680 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:48.672801 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:48.673544 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:48.674523 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:48.674841 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:48.674919 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:48.675625 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:48.675627 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:48.675627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:48.675632 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:48.675649 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:48.675654 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:48.675723 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:48.675790 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 02:36:48.675804 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 02:36:48.685773 23330 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:48.686550 23330 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:48.692186 23330 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a147743d92f243218af3c73d93317e60: Generated new TSK 0
I20260811 02:36:48.692596 23330 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:48.700899 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23190
W20260811 02:36:48.722790 23159 connection.cc:535] client connection to 127.0.0.1:42619 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42619): Connection reset by peer (error 104)
2026-08-11T02:36:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1614 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:48 dist-test-slave-7nm7 krb5kdc[23359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:48 dist-test-slave-7nm7 krb5kdc[23359](info): set up 2 sockets
Aug 11 02:36:48 dist-test-slave-7nm7 krb5kdc[23359](info): commencing operation
krb5kdc: starting...
W20260811 02:36:50.014961 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:50 dist-test-slave-7nm7 krb5kdc[23359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 02:36:50.149291 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37015
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44043
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:50.234899 23378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:50.235119 23378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:50.235150 23378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:50.236685 23378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:50.236742 23378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:50.236757 23378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:50.236770 23378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:50.236783 23378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:50.238372 23378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44043
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37015
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:50.238583 23378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:50.238755 23378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:50.243875 23385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:50.243883 23388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:50.243914 23378 server_base.cc:1034] running on GCE node
W20260811 02:36:50.243894 23393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:50.244403 23378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:50.244696 23378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:50.245874 23378 hybrid_clock.cc:648] HybridClock initialized: now 1786415810245851 us; error 38 us; skew 500 ppm
Aug 11 02:36:50 dist-test-slave-7nm7 krb5kdc[23359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415810, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:50.248767 23378 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 02:36:50.249179 23378 webserver.cc:460] Webserver started at http://127.0.0.1:43603/ using document root <none> and password file <none>
I20260811 02:36:50.249415 23378 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:50.249465 23378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:50.249596 23378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:50.250746 23378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "87679eec81f04cea955a672f3b93ca20"
format_stamp: "Formatted at 2026-08-11 02:36:50 on dist-test-slave-7nm7"
server_key: "29dfa9a8d7b745bad2a7d106b187b753"
server_key_iv: "881cc5c612771226a32edc9deeedf92d"
server_key_version: "encryptionkey@0"
I20260811 02:36:50.251119 23378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "87679eec81f04cea955a672f3b93ca20"
format_stamp: "Formatted at 2026-08-11 02:36:50 on dist-test-slave-7nm7"
server_key: "29dfa9a8d7b745bad2a7d106b187b753"
server_key_iv: "881cc5c612771226a32edc9deeedf92d"
server_key_version: "encryptionkey@0"
I20260811 02:36:50.252562 23378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 02:36:50.253432 23411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:50.253638 23378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:50.253756 23378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "87679eec81f04cea955a672f3b93ca20"
format_stamp: "Formatted at 2026-08-11 02:36:50 on dist-test-slave-7nm7"
server_key: "29dfa9a8d7b745bad2a7d106b187b753"
server_key_iv: "881cc5c612771226a32edc9deeedf92d"
server_key_version: "encryptionkey@0"
I20260811 02:36:50.253841 23378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:50.257242 23378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:50.260011 23378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:50.260193 23378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:50.265349 23378 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37015
I20260811 02:36:50.265383 23488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37015 every 8 connection(s)
I20260811 02:36:50.265741 23378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:50.266826 23490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:50.269143 23490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20: Bootstrap starting.
I20260811 02:36:50.269752 23490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:50.270037 23490 log.cc:824] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:50.270818 23490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20: No bootstrap required, opened a new log
I20260811 02:36:50.272392 23490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87679eec81f04cea955a672f3b93ca20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260811 02:36:50.272552 23490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:50.272603 23490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87679eec81f04cea955a672f3b93ca20, State: Initialized, Role: FOLLOWER
I20260811 02:36:50.272775 23490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87679eec81f04cea955a672f3b93ca20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260811 02:36:50.272859 23490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:50.272903 23490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:50.272954 23490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:50.273489 23490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87679eec81f04cea955a672f3b93ca20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260811 02:36:50.273610 23490 leader_election.cc:302] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87679eec81f04cea955a672f3b93ca20; no voters:
I20260811 02:36:50.273814 23490 leader_election.cc:288] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:50.273907 23495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:50.274096 23495 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [term 1 LEADER]: Becoming Leader. State: Replica: 87679eec81f04cea955a672f3b93ca20, State: Running, Role: LEADER
I20260811 02:36:50.274106 23490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:50.274334 23495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87679eec81f04cea955a672f3b93ca20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } }
I20260811 02:36:50.274755 23496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87679eec81f04cea955a672f3b93ca20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87679eec81f04cea955a672f3b93ca20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } } }
I20260811 02:36:50.274894 23497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87679eec81f04cea955a672f3b93ca20. Latest consensus state: current_term: 1 leader_uuid: "87679eec81f04cea955a672f3b93ca20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87679eec81f04cea955a672f3b93ca20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37015 } } }
I20260811 02:36:50.274991 23497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:50.275235 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23378
I20260811 02:36:50.274914 23496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:50.275357 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:50.275429 23510 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:50.275588 17724 external_mini_cluster.cc:1428] Setting key 03f58382fd9d6f90f88dfb2c9bad9d79
I20260811 02:36:50.275959 23510 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:50.277697 23510 catalog_manager.cc:1347] Generated new cluster ID: dee7876732e14c22a3ae648d978c5d17
I20260811 02:36:50.277760 23510 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:50.278388 23530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:50.276310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:57997 (local address 127.0.0.1:37015)
0811 02:36:50.276670 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:50.276679 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:50.276715 (+ 36us) server_negotiation.cc:407] Connection header received
0811 02:36:50.276825 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:50.276832 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:50.276862 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:50.277008 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:50.277888 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:50.277891 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:50.277892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:50.277897 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:50.277946 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:50.277958 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:50.278036 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:50.278115 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 02:36:50.278161 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":77,"threads_started":1}
I20260811 02:36:50.279371 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:50.283499 23530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:50.280754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.43:44415 (local address 127.0.0.1:37015)
0811 02:36:50.280792 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:50.280794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:50.282460 (+ 1666us) server_negotiation.cc:407] Connection header received
0811 02:36:50.282549 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:50.282550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:50.282556 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:50.282602 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:50.283246 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:50.283248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:50.283248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:50.283252 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:50.283268 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:50.283272 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:50.283343 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:50.283401 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 02:36:50.283416 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:36:50.298468 23510 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:50.298702 23510 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:50.300699 23510 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87679eec81f04cea955a672f3b93ca20: Generated new TSK 0
I20260811 02:36:50.300894 23510 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:50.303468 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23378
2026-08-11T02:36:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1595 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:50 dist-test-slave-7nm7 krb5kdc[23552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:50 dist-test-slave-7nm7 krb5kdc[23552](info): set up 2 sockets
Aug 11 02:36:50 dist-test-slave-7nm7 krb5kdc[23552](info): commencing operation
krb5kdc: starting...
W20260811 02:36:51.618532 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:51 dist-test-slave-7nm7 krb5kdc[23552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:51.741210 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39963
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:42835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:39963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:51.825131 23581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:51.825366 23581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:51.825394 23581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:51.826676 23581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:51.826727 23581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:51.826742 23581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:51.826756 23581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:51.826767 23581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:51.828279 23581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:42835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:39963
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:39963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:51.828540 23581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:51.828779 23581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:51.833839 23594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:51.833994 23592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:51.833885 23591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:51.834455 23581 server_base.cc:1034] running on GCE node
I20260811 02:36:51.834774 23581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:51.835172 23581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:51.836367 23581 hybrid_clock.cc:648] HybridClock initialized: now 1786415811836352 us; error 30 us; skew 500 ppm
Aug 11 02:36:51 dist-test-slave-7nm7 krb5kdc[23552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415811, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:51.839511 23581 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:51.840027 23581 webserver.cc:460] Webserver started at http://127.17.79.62:46039/ using document root <none> and password file <none>
I20260811 02:36:51.840293 23581 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:51.840369 23581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:51.840523 23581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:51.842078 23581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "866b962e47b542ec8da9e6fc78299df3"
format_stamp: "Formatted at 2026-08-11 02:36:51 on dist-test-slave-7nm7"
server_key: "c8b469cc6427be423d8ced5832f66256"
server_key_iv: "eda7973c154853578ba07816f6c0bb13"
server_key_version: "encryptionkey@0"
I20260811 02:36:51.842558 23581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "866b962e47b542ec8da9e6fc78299df3"
format_stamp: "Formatted at 2026-08-11 02:36:51 on dist-test-slave-7nm7"
server_key: "c8b469cc6427be423d8ced5832f66256"
server_key_iv: "eda7973c154853578ba07816f6c0bb13"
server_key_version: "encryptionkey@0"
I20260811 02:36:51.843976 23581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:51.844970 23601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:51.845230 23581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:51.845367 23581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "866b962e47b542ec8da9e6fc78299df3"
format_stamp: "Formatted at 2026-08-11 02:36:51 on dist-test-slave-7nm7"
server_key: "c8b469cc6427be423d8ced5832f66256"
server_key_iv: "eda7973c154853578ba07816f6c0bb13"
server_key_version: "encryptionkey@0"
I20260811 02:36:51.845449 23581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:51.863384 23581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:51.865469 23581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:51.865656 23581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:51.870299 23581 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:39963
I20260811 02:36:51.870349 23684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:39963 every 8 connection(s)
I20260811 02:36:51.870733 23581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:51.871634 23687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:51.873932 23687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3: Bootstrap starting.
I20260811 02:36:51.874624 23687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:51.874929 23687 log.cc:824] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:51.875722 23687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3: No bootstrap required, opened a new log
I20260811 02:36:51.877072 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23581
I20260811 02:36:51.877224 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:51.877463 17724 external_mini_cluster.cc:1428] Setting key e29e43e64e0d946817a6c77218dc487c
I20260811 02:36:51.877513 23687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866b962e47b542ec8da9e6fc78299df3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39963 } }
I20260811 02:36:51.877701 23687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:51.877754 23687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 866b962e47b542ec8da9e6fc78299df3, State: Initialized, Role: FOLLOWER
I20260811 02:36:51.877905 23687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866b962e47b542ec8da9e6fc78299df3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39963 } }
I20260811 02:36:51.877995 23687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:51.878028 23687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:51.878072 23687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:51.878877 23687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866b962e47b542ec8da9e6fc78299df3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39963 } }
I20260811 02:36:51.878997 23687 leader_election.cc:302] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 866b962e47b542ec8da9e6fc78299df3; no voters:
I20260811 02:36:51.879240 23687 leader_election.cc:288] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:51.879300 23696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:51.879474 23696 raft_consensus.cc:686] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [term 1 LEADER]: Becoming Leader. State: Replica: 866b962e47b542ec8da9e6fc78299df3, State: Running, Role: LEADER
I20260811 02:36:51.879516 23687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:51.879678 23696 consensus_queue.cc:237] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866b962e47b542ec8da9e6fc78299df3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39963 } }
I20260811 02:36:51.880046 23696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 866b962e47b542ec8da9e6fc78299df3. Latest consensus state: current_term: 1 leader_uuid: "866b962e47b542ec8da9e6fc78299df3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866b962e47b542ec8da9e6fc78299df3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39963 } } }
I20260811 02:36:51.880157 23696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:51.880360 23704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:51.880919 23704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:51.881362 23697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "866b962e47b542ec8da9e6fc78299df3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "866b962e47b542ec8da9e6fc78299df3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 39963 } } }
I20260811 02:36:51.881438 23697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:51.882655 23704 catalog_manager.cc:1347] Generated new cluster ID: 68175e0257284cde94cb6b6d8d998e72
I20260811 02:36:51.882712 23704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:36:51 dist-test-slave-7nm7 krb5kdc[23552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:51.890565 23695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:51.878059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51615 (local address 127.17.79.62:39963)
0811 02:36:51.878326 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:51.878336 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:51.878374 (+ 38us) server_negotiation.cc:407] Connection header received
0811 02:36:51.878782 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:51.878791 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:51.878855 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:51.879011 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:51.880045 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:51.881585 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:51.882654 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:51.883239 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:51.883345 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:51.886416 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:51.886421 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:51.886421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:51.886434 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:51.888639 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:51.889152 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:51.889155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:51.889156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:51.889287 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:51.889557 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:51.889559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:51.889559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:51.889858 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:51.890038 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:51.890195 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 02:36:51.890350 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":104,"threads_started":1}
I20260811 02:36:51.890599 23704 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:51.891709 23704 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:51.891775 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:51.899796 23704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 866b962e47b542ec8da9e6fc78299df3: Generated new TSK 0
I20260811 02:36:51.899979 23704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:51.900990 23695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:51.893123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58133 (local address 127.17.79.62:39963)
0811 02:36:51.893163 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:51.893165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:51.893321 (+ 156us) server_negotiation.cc:407] Connection header received
0811 02:36:51.893374 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:51.893375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:51.893385 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:51.893442 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:51.894074 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:51.894872 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:51.896054 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:51.896375 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:51.896430 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:51.897968 (+ 1538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:51.897970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:51.897970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:51.897976 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:51.899585 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:51.900026 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:51.900027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:51.900027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:51.900211 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:51.900459 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:51.900460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:51.900461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:51.900597 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:51.900705 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:51.900803 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 02:36:51.900892 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:36:51.903136 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23581
W20260811 02:36:51.918780 23548 connection.cc:535] client connection to 127.17.79.62:39963 recv error: Network error: failed to read from TLS socket (remote: 127.17.79.62:39963): Connection reset by peer (error 104)
2026-08-11T02:36:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:51 dist-test-slave-7nm7 krb5kdc[23736](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:51 dist-test-slave-7nm7 krb5kdc[23736](info): set up 2 sockets
Aug 11 02:36:51 dist-test-slave-7nm7 krb5kdc[23736](info): commencing operation
krb5kdc: starting...
W20260811 02:36:53.210536 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.277s user 0.004s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:53 dist-test-slave-7nm7 krb5kdc[23736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:53.332844 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44955
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:39891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:44955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:53.422502 23756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:53.423017 23756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:53.423123 23756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:53.424357 23756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:53.424430 23756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:53.424464 23756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:53.424494 23756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:53.424518 23756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:53.426082 23756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:39891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:44955
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:44955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:53.426406 23756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:53.426651 23756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:53.431874 23771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:53.431883 23776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:53.432020 23756 server_base.cc:1034] running on GCE node
W20260811 02:36:53.431859 23764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:53.432394 23756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:53.432726 23756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:53.433895 23756 hybrid_clock.cc:648] HybridClock initialized: now 1786415813433880 us; error 27 us; skew 500 ppm
Aug 11 02:36:53 dist-test-slave-7nm7 krb5kdc[23736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415813, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:53.436314 23756 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:53.436738 23756 webserver.cc:460] Webserver started at http://127.17.79.62:44565/ using document root <none> and password file <none>
I20260811 02:36:53.436980 23756 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:53.437054 23756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:53.437201 23756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:53.438335 23756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "6c0ab3379c2f48a2b26a1f21381191a3"
format_stamp: "Formatted at 2026-08-11 02:36:53 on dist-test-slave-7nm7"
server_key: "1f0b6062582e6883b72d314cb1006db7"
server_key_iv: "3a583d059a9ab3368563ab4f8d0f9acf"
server_key_version: "encryptionkey@0"
I20260811 02:36:53.438736 23756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "6c0ab3379c2f48a2b26a1f21381191a3"
format_stamp: "Formatted at 2026-08-11 02:36:53 on dist-test-slave-7nm7"
server_key: "1f0b6062582e6883b72d314cb1006db7"
server_key_iv: "3a583d059a9ab3368563ab4f8d0f9acf"
server_key_version: "encryptionkey@0"
I20260811 02:36:53.440080 23756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:53.440834 23792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:53.441005 23756 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 02:36:53.441113 23756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "6c0ab3379c2f48a2b26a1f21381191a3"
format_stamp: "Formatted at 2026-08-11 02:36:53 on dist-test-slave-7nm7"
server_key: "1f0b6062582e6883b72d314cb1006db7"
server_key_iv: "3a583d059a9ab3368563ab4f8d0f9acf"
server_key_version: "encryptionkey@0"
I20260811 02:36:53.441186 23756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:53.451470 23756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:53.453519 23756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:53.453691 23756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:53.458214 23756 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:44955
I20260811 02:36:53.458498 23871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:44955 every 8 connection(s)
I20260811 02:36:53.458797 23756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:53.459759 23873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:53.462026 23873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3: Bootstrap starting.
I20260811 02:36:53.462687 23873 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:53.462927 23873 log.cc:824] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:53.463696 23873 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3: No bootstrap required, opened a new log
I20260811 02:36:53.465845 23873 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44955 } }
I20260811 02:36:53.466094 23873 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:53.466121 23873 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c0ab3379c2f48a2b26a1f21381191a3, State: Initialized, Role: FOLLOWER
I20260811 02:36:53.466383 23873 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44955 } }
I20260811 02:36:53.466589 23873 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:53.466645 23873 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:53.466697 23873 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:53.467661 23873 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44955 } }
I20260811 02:36:53.467757 23873 leader_election.cc:302] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c0ab3379c2f48a2b26a1f21381191a3; no voters:
I20260811 02:36:53.467882 23873 leader_election.cc:288] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:53.467957 23881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:53.468189 23881 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6c0ab3379c2f48a2b26a1f21381191a3, State: Running, Role: LEADER
I20260811 02:36:53.468179 23873 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:53.468516 23881 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44955 } }
I20260811 02:36:53.468873 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23756
I20260811 02:36:53.468993 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:53.468961 23883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44955 } } }
I20260811 02:36:53.469036 23883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:53.469241 17724 external_mini_cluster.cc:1428] Setting key 35214a48720442a99d071b669b2a479d
I20260811 02:36:53.469214 23884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c0ab3379c2f48a2b26a1f21381191a3. Latest consensus state: current_term: 1 leader_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c0ab3379c2f48a2b26a1f21381191a3" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 44955 } } }
I20260811 02:36:53.469270 23884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:53.469594 23894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:53.470165 23894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:53.472014 23894 catalog_manager.cc:1347] Generated new cluster ID: 79730bf53c1041f2910ed2c703990266
I20260811 02:36:53.472069 23894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:53.475690 23901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:53.469726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42453 (local address 127.17.79.62:44955)
0811 02:36:53.469909 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:53.469919 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:53.469957 (+ 38us) server_negotiation.cc:407] Connection header received
0811 02:36:53.470145 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:53.470155 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:53.470217 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:53.470377 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:53.470823 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:53.472066 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:53.473171 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:53.473773 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:53.473866 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:53.474809 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:53.474812 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:53.474813 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:53.475011 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:53.475046 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:53.475060 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:53.475125 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:53.475299 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 02:36:53.475325 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":65,"threads_started":1}
I20260811 02:36:53.476696 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:53.481549 23901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:53.478217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49307 (local address 127.17.79.62:44955)
0811 02:36:53.478272 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:53.478273 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:53.478287 (+ 14us) server_negotiation.cc:407] Connection header received
0811 02:36:53.478359 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:53.478360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:53.478371 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:53.478430 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:53.478532 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:53.479269 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:53.480219 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:53.480536 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:53.480613 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:53.481296 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:53.481297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:53.481297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:53.481302 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:53.481318 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:53.481323 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:53.481382 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:53.481461 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 02:36:53.481473 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 02:36:53.489739 23894 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:53.490460 23894 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:53.494279 23894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c0ab3379c2f48a2b26a1f21381191a3: Generated new TSK 0
I20260811 02:36:53.494480 23894 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:53.497587 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23756
W20260811 02:36:53.521699 23731 connection.cc:535] client connection to 127.17.79.62:44955 recv error: Network error: failed to read from TLS socket (remote: 127.17.79.62:44955): Connection reset by peer (error 104)
2026-08-11T02:36:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:53 dist-test-slave-7nm7 krb5kdc[23934](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:53 dist-test-slave-7nm7 krb5kdc[23934](info): set up 2 sockets
Aug 11 02:36:53 dist-test-slave-7nm7 krb5kdc[23934](info): commencing operation
krb5kdc: starting...
W20260811 02:36:54.850735 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:54 dist-test-slave-7nm7 krb5kdc[23934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:54.979012 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46767
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:41971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:46767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:55.067413 23957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:55.067643 23957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:55.067667 23957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:55.068773 23957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:55.068810 23957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:55.068825 23957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:55.068838 23957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:55.068850 23957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:55.070345 23957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:41971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:46767
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:46767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:55.070569 23957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:55.070757 23957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:55.075954 23970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:55.075945 23966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:55.075945 23973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:55.076395 23957 server_base.cc:1034] running on GCE node
I20260811 02:36:55.076660 23957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:55.077003 23957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:55.078181 23957 hybrid_clock.cc:648] HybridClock initialized: now 1786415815078153 us; error 39 us; skew 500 ppm
Aug 11 02:36:55 dist-test-slave-7nm7 krb5kdc[23934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415815, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:55.080857 23957 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:55.081326 23957 webserver.cc:460] Webserver started at http://127.17.79.62:43105/ using document root <none> and password file <none>
I20260811 02:36:55.081532 23957 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:55.081573 23957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:55.081670 23957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:55.082767 23957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "bdae1f32cb964587b4bab8a9dfa7507d"
format_stamp: "Formatted at 2026-08-11 02:36:55 on dist-test-slave-7nm7"
server_key: "4105077203601f2b5e5291c705306579"
server_key_iv: "91b6538b3df90fa38f1440aac31b7437"
server_key_version: "encryptionkey@0"
I20260811 02:36:55.083096 23957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "bdae1f32cb964587b4bab8a9dfa7507d"
format_stamp: "Formatted at 2026-08-11 02:36:55 on dist-test-slave-7nm7"
server_key: "4105077203601f2b5e5291c705306579"
server_key_iv: "91b6538b3df90fa38f1440aac31b7437"
server_key_version: "encryptionkey@0"
I20260811 02:36:55.084436 23957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:55.085354 23982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:55.085548 23957 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:55.085642 23957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "bdae1f32cb964587b4bab8a9dfa7507d"
format_stamp: "Formatted at 2026-08-11 02:36:55 on dist-test-slave-7nm7"
server_key: "4105077203601f2b5e5291c705306579"
server_key_iv: "91b6538b3df90fa38f1440aac31b7437"
server_key_version: "encryptionkey@0"
I20260811 02:36:55.085704 23957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:55.088929 23957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:55.091161 23957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:55.091341 23957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:55.095824 23957 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:46767
I20260811 02:36:55.095901 24067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:46767 every 8 connection(s)
I20260811 02:36:55.096233 23957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:55.097292 24070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:55.099890 24070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d: Bootstrap starting.
I20260811 02:36:55.100445 24070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:55.100678 24070 log.cc:824] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:55.101364 24070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d: No bootstrap required, opened a new log
I20260811 02:36:55.103000 24070 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46767 } }
I20260811 02:36:55.103142 24070 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:55.103165 24070 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdae1f32cb964587b4bab8a9dfa7507d, State: Initialized, Role: FOLLOWER
I20260811 02:36:55.103312 24070 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46767 } }
I20260811 02:36:55.103390 24070 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:55.103413 24070 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:55.103442 24070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:55.104252 24070 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46767 } }
I20260811 02:36:55.104341 24070 leader_election.cc:302] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdae1f32cb964587b4bab8a9dfa7507d; no voters:
I20260811 02:36:55.104502 24070 leader_election.cc:288] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:55.104533 24075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:55.104658 24075 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [term 1 LEADER]: Becoming Leader. State: Replica: bdae1f32cb964587b4bab8a9dfa7507d, State: Running, Role: LEADER
I20260811 02:36:55.104758 24075 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46767 } }
I20260811 02:36:55.104794 24070 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:55.105481 24079 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46767 } } }
I20260811 02:36:55.105511 24077 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdae1f32cb964587b4bab8a9dfa7507d. Latest consensus state: current_term: 1 leader_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdae1f32cb964587b4bab8a9dfa7507d" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 46767 } } }
I20260811 02:36:55.105581 24079 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:55.105598 24077 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:55.105651 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 23957
I20260811 02:36:55.105769 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:55.105994 17724 external_mini_cluster.cc:1428] Setting key 6b2f2d58294a35017478bbed2f1a4f53
I20260811 02:36:55.106089 24091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:55.106877 24091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:55.109076 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:55.106524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55125 (local address 127.17.79.62:46767)
0811 02:36:55.107542 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:55.107550 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:55.107584 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:36:55.107705 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:55.107712 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:55.107741 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:55.107890 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:55.108645 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:55.108650 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:55.108651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:55.108659 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:55.108695 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:55.108706 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:55.108779 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:55.108867 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 02:36:55.108907 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":969,"thread_start_us":62,"threads_started":1}
I20260811 02:36:55.109635 24091 catalog_manager.cc:1347] Generated new cluster ID: e3ead23772584b5aa29397e782a2cb28
I20260811 02:36:55.109694 24091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:55.110219 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:55.119724 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:55.111691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60987 (local address 127.17.79.62:46767)
0811 02:36:55.111736 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:55.111738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:55.118564 (+ 6826us) server_negotiation.cc:407] Connection header received
0811 02:36:55.118663 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:55.118664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:55.118692 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:55.118767 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:55.119464 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:55.119465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:55.119466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:55.119470 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:55.119485 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:55.119489 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:55.119543 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:55.119605 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 02:36:55.119620 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 02:36:55.122344 24091 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:55.122524 24091 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:55.128270 24091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdae1f32cb964587b4bab8a9dfa7507d: Generated new TSK 0
I20260811 02:36:55.128480 24091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:55.135872 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 23957
2026-08-11T02:36:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1632 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:55 dist-test-slave-7nm7 krb5kdc[24128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:55 dist-test-slave-7nm7 krb5kdc[24128](info): set up 2 sockets
Aug 11 02:36:55 dist-test-slave-7nm7 krb5kdc[24128](info): commencing operation
krb5kdc: starting...
W20260811 02:36:56.439592 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.271s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:56 dist-test-slave-7nm7 krb5kdc[24128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:56.563242 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35879
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:35879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:56.644591 24145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:56.644891 24145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:56.644933 24145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:56.646092 24145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:56.646167 24145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:56.646195 24145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:56.646255 24145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:56.646278 24145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:56.647819 24145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:35879
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:35879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:56.648113 24145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:56.648355 24145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:56.654376 24152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:56.654392 24151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:56.654721 24154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:56.654949 24145 server_base.cc:1034] running on GCE node
I20260811 02:36:56.655201 24145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:56.655526 24145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:56.656714 24145 hybrid_clock.cc:648] HybridClock initialized: now 1786415816656692 us; error 40 us; skew 500 ppm
Aug 11 02:36:56 dist-test-slave-7nm7 krb5kdc[24128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415816, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:56.659406 24145 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:56.659933 24145 webserver.cc:460] Webserver started at http://127.17.79.62:32897/ using document root <none> and password file <none>
I20260811 02:36:56.660197 24145 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:56.660269 24145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:56.660422 24145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:56.661505 24145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "dff4d3b9a0b9429787698f99c52307f2"
format_stamp: "Formatted at 2026-08-11 02:36:56 on dist-test-slave-7nm7"
server_key: "e52bb5b9c33a10b59210a1d91cb6aec9"
server_key_iv: "6a900e387dd01df9932abf8d7cf01c29"
server_key_version: "encryptionkey@0"
I20260811 02:36:56.661885 24145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "dff4d3b9a0b9429787698f99c52307f2"
format_stamp: "Formatted at 2026-08-11 02:36:56 on dist-test-slave-7nm7"
server_key: "e52bb5b9c33a10b59210a1d91cb6aec9"
server_key_iv: "6a900e387dd01df9932abf8d7cf01c29"
server_key_version: "encryptionkey@0"
I20260811 02:36:56.663416 24145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:36:56.664417 24164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:56.664610 24145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:56.664722 24145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "dff4d3b9a0b9429787698f99c52307f2"
format_stamp: "Formatted at 2026-08-11 02:36:56 on dist-test-slave-7nm7"
server_key: "e52bb5b9c33a10b59210a1d91cb6aec9"
server_key_iv: "6a900e387dd01df9932abf8d7cf01c29"
server_key_version: "encryptionkey@0"
I20260811 02:36:56.664815 24145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:56.674158 24145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:56.676720 24145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:56.676903 24145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:56.681499 24145 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:35879
I20260811 02:36:56.681533 24246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:35879 every 8 connection(s)
I20260811 02:36:56.681890 24145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:56.682854 24247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:56.685340 24247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2: Bootstrap starting.
I20260811 02:36:56.685956 24247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:56.686296 24247 log.cc:824] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:56.687026 24247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2: No bootstrap required, opened a new log
I20260811 02:36:56.688639 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24145
I20260811 02:36:56.688766 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:56.688966 17724 external_mini_cluster.cc:1428] Setting key cf019f93e9103a9fb83a8bf3369c84e3
I20260811 02:36:56.688885 24247 raft_consensus.cc:348] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff4d3b9a0b9429787698f99c52307f2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35879 } }
I20260811 02:36:56.689061 24247 raft_consensus.cc:374] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:56.689110 24247 raft_consensus.cc:729] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dff4d3b9a0b9429787698f99c52307f2, State: Initialized, Role: FOLLOWER
I20260811 02:36:56.689289 24247 consensus_queue.cc:260] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff4d3b9a0b9429787698f99c52307f2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35879 } }
I20260811 02:36:56.689386 24247 raft_consensus.cc:388] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:56.689422 24247 raft_consensus.cc:482] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:56.689476 24247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:56.690125 24247 raft_consensus.cc:504] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff4d3b9a0b9429787698f99c52307f2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35879 } }
I20260811 02:36:56.690271 24247 leader_election.cc:302] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dff4d3b9a0b9429787698f99c52307f2; no voters:
I20260811 02:36:56.690460 24247 leader_election.cc:288] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:56.690483 24255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:56.690598 24255 raft_consensus.cc:686] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [term 1 LEADER]: Becoming Leader. State: Replica: dff4d3b9a0b9429787698f99c52307f2, State: Running, Role: LEADER
I20260811 02:36:56.690735 24255 consensus_queue.cc:237] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff4d3b9a0b9429787698f99c52307f2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35879 } }
I20260811 02:36:56.690745 24247 sys_catalog.cc:564] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:56.692607 24256 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dff4d3b9a0b9429787698f99c52307f2. Latest consensus state: current_term: 1 leader_uuid: "dff4d3b9a0b9429787698f99c52307f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff4d3b9a0b9429787698f99c52307f2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35879 } } }
I20260811 02:36:56.692795 24256 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [sys.catalog]: This master's current role is: LEADER
W20260811 02:36:56.692839 24286 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:36:56.692941 24286 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:36:56.693070 24290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:56.693272 24290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:56.693884 24257 sys_catalog.cc:455] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dff4d3b9a0b9429787698f99c52307f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dff4d3b9a0b9429787698f99c52307f2" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 35879 } } }
I20260811 02:36:56.694028 24257 sys_catalog.cc:458] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:56.695752 24290 catalog_manager.cc:1347] Generated new cluster ID: d3c814e2ab7048fc98288a8c4cdca509
I20260811 02:36:56.695815 24290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 02:36:56 dist-test-slave-7nm7 krb5kdc[24128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:36:56.701824 24253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:56.689516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42573 (local address 127.17.79.62:35879)
0811 02:36:56.689706 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:56.689715 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:56.689756 (+ 41us) server_negotiation.cc:407] Connection header received
0811 02:36:56.690089 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:56.690095 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:56.690138 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:56.690338 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:56.691138 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:56.692275 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:56.693367 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:56.693973 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:56.694081 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:56.696810 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:56.696814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:56.696814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:56.696827 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:56.699568 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:56.700271 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:56.700275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:56.700275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:56.700413 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:56.700701 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:56.700702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:56.700703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:56.701043 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:56.701221 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:56.701306 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 02:36:56.701591 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
I20260811 02:36:56.702867 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:56.711921 24253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:56.704447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44035 (local address 127.17.79.62:35879)
0811 02:36:56.704493 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:56.704495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:56.704631 (+ 136us) server_negotiation.cc:407] Connection header received
0811 02:36:56.704681 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:56.704682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:56.704692 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:56.704768 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:56.705388 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:56.706146 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:56.707142 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:56.707483 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:56.707559 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:56.709005 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:56.709007 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:56.709007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:36:56.709015 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:56.710703 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:56.711089 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:56.711090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:56.711091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:56.711154 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:36:56.711360 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:36:56.711361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:36:56.711361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:36:56.711499 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:56.711598 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:56.711717 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 02:36:56.711807 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:36:56.715622 24290 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:56.716727 24290 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:56.724468 24290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dff4d3b9a0b9429787698f99c52307f2: Generated new TSK 0
I20260811 02:36:56.724704 24290 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:56.728322 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24145
2026-08-11T02:36:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:56 dist-test-slave-7nm7 krb5kdc[24301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:56 dist-test-slave-7nm7 krb5kdc[24301](info): set up 2 sockets
Aug 11 02:36:56 dist-test-slave-7nm7 krb5kdc[24301](info): commencing operation
krb5kdc: starting...
W20260811 02:36:58.030560 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:58 dist-test-slave-7nm7 krb5kdc[24301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:58.157644 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:40671
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:37223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:40671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:58.243099 24328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:58.243348 24328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:58.243391 24328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:58.244683 24328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:58.244798 24328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:58.244829 24328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:58.244880 24328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:58.244910 24328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:58.246615 24328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:37223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:40671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:40671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:58.246912 24328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:58.247151 24328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:58.252323 24346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:58.252319 24340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:58.252357 24339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:58.252717 24328 server_base.cc:1034] running on GCE node
I20260811 02:36:58.253018 24328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:58.253397 24328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:58.254572 24328 hybrid_clock.cc:648] HybridClock initialized: now 1786415818254562 us; error 43 us; skew 500 ppm
Aug 11 02:36:58 dist-test-slave-7nm7 krb5kdc[24301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415818, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:58.257762 24328 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:58.258373 24328 webserver.cc:460] Webserver started at http://127.17.79.62:46757/ using document root <none> and password file <none>
I20260811 02:36:58.258656 24328 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:58.258730 24328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:58.258898 24328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:58.259999 24328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "c17cd4199aea4f93af7a7a19142356e0"
format_stamp: "Formatted at 2026-08-11 02:36:58 on dist-test-slave-7nm7"
server_key: "6614e26a660ff23ef91c34d974ca9175"
server_key_iv: "4a3bc1befc9a35c8b310e7edfdbd235a"
server_key_version: "encryptionkey@0"
I20260811 02:36:58.260385 24328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "c17cd4199aea4f93af7a7a19142356e0"
format_stamp: "Formatted at 2026-08-11 02:36:58 on dist-test-slave-7nm7"
server_key: "6614e26a660ff23ef91c34d974ca9175"
server_key_iv: "4a3bc1befc9a35c8b310e7edfdbd235a"
server_key_version: "encryptionkey@0"
I20260811 02:36:58.261858 24328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 02:36:58.262820 24355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:58.263073 24328 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:36:58.263203 24328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "c17cd4199aea4f93af7a7a19142356e0"
format_stamp: "Formatted at 2026-08-11 02:36:58 on dist-test-slave-7nm7"
server_key: "6614e26a660ff23ef91c34d974ca9175"
server_key_iv: "4a3bc1befc9a35c8b310e7edfdbd235a"
server_key_version: "encryptionkey@0"
I20260811 02:36:58.263304 24328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:58.290485 24328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:58.293031 24328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:58.293223 24328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:58.297644 24328 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:40671
I20260811 02:36:58.297680 24432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:40671 every 8 connection(s)
I20260811 02:36:58.298062 24328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:58.299006 24433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:58.301546 24433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0: Bootstrap starting.
I20260811 02:36:58.302155 24433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:58.302482 24433 log.cc:824] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:58.303234 24433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0: No bootstrap required, opened a new log
I20260811 02:36:58.303967 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24328
I20260811 02:36:58.304087 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:58.304280 17724 external_mini_cluster.cc:1428] Setting key 4c3ec8404c25d814d3361ef35ee0bb5f
I20260811 02:36:58.305588 24433 raft_consensus.cc:348] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17cd4199aea4f93af7a7a19142356e0" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40671 } }
I20260811 02:36:58.305769 24433 raft_consensus.cc:374] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:58.305810 24433 raft_consensus.cc:729] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c17cd4199aea4f93af7a7a19142356e0, State: Initialized, Role: FOLLOWER
I20260811 02:36:58.305938 24433 consensus_queue.cc:260] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17cd4199aea4f93af7a7a19142356e0" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40671 } }
I20260811 02:36:58.306032 24433 raft_consensus.cc:388] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:58.306066 24433 raft_consensus.cc:482] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:58.306137 24433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:58.306963 24433 raft_consensus.cc:504] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17cd4199aea4f93af7a7a19142356e0" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40671 } }
I20260811 02:36:58.307080 24433 leader_election.cc:302] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c17cd4199aea4f93af7a7a19142356e0; no voters:
I20260811 02:36:58.307241 24433 leader_election.cc:288] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:58.307296 24441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:58.307560 24441 raft_consensus.cc:686] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [term 1 LEADER]: Becoming Leader. State: Replica: c17cd4199aea4f93af7a7a19142356e0, State: Running, Role: LEADER
I20260811 02:36:58.307634 24433 sys_catalog.cc:564] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:58.307668 24441 consensus_queue.cc:237] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17cd4199aea4f93af7a7a19142356e0" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40671 } }
I20260811 02:36:58.308003 24441 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c17cd4199aea4f93af7a7a19142356e0. Latest consensus state: current_term: 1 leader_uuid: "c17cd4199aea4f93af7a7a19142356e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17cd4199aea4f93af7a7a19142356e0" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40671 } } }
I20260811 02:36:58.308101 24441 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:58.308015 24444 sys_catalog.cc:455] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c17cd4199aea4f93af7a7a19142356e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c17cd4199aea4f93af7a7a19142356e0" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 40671 } } }
I20260811 02:36:58.308229 24444 sys_catalog.cc:458] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0 [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:58.308333 24459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:58.308849 24459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:58.310591 24459 catalog_manager.cc:1347] Generated new cluster ID: 3e7d17c98e2344588627625375459ba7
I20260811 02:36:58.310660 24459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:58.311872 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:58.304857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48365 (local address 127.17.79.62:40671)
0811 02:36:58.305069 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:58.305079 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:58.305118 (+ 39us) server_negotiation.cc:407] Connection header received
0811 02:36:58.305543 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:58.305551 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:58.305646 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:58.305791 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:58.306154 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:58.308024 (+ 1870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:58.309508 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:58.310166 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:58.310358 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:58.311206 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:58.311210 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:58.311210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:58.311382 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:58.311413 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:58.311423 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:58.311505 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:58.311595 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 02:36:58.311664 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260811 02:36:58.312865 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:58.321173 24440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:58.314319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59119 (local address 127.17.79.62:40671)
0811 02:36:58.314358 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:58.314360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:58.318453 (+ 4093us) server_negotiation.cc:407] Connection header received
0811 02:36:58.318529 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:58.318530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:58.318543 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:58.318600 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:58.318757 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:58.319228 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:58.319943 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:36:58.320154 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:36:58.320239 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:36:58.320928 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:58.320930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:58.320930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:58.320935 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:58.320948 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:58.320952 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:58.320999 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:58.321049 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 02:36:58.321071 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:36:58.336453 24459 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:58.337234 24459 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:58.350790 24459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c17cd4199aea4f93af7a7a19142356e0: Generated new TSK 0
I20260811 02:36:58.351032 24459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:58.354971 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24328
2026-08-11T02:36:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1632 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:36:58 dist-test-slave-7nm7 krb5kdc[24494](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:36:58 dist-test-slave-7nm7 krb5kdc[24494](info): set up 2 sockets
Aug 11 02:36:58 dist-test-slave-7nm7 krb5kdc[24494](info): commencing operation
krb5kdc: starting...
W20260811 02:36:59.673257 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:36:59 dist-test-slave-7nm7 krb5kdc[24494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:36:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:36:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:36:59.804685 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36053
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:44905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:36053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:36:59.885334 24525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:36:59.885578 24525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:36:59.885614 24525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:36:59.886741 24525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:36:59.886818 24525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:36:59.886845 24525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:36:59.886879 24525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:36:59.886901 24525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:36:59.888355 24525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:44905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:36053
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:36053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:36:59.888624 24525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:36:59.888854 24525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:36:59.893635 24539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:59.893662 24536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:36:59.893662 24541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:36:59.893872 24525 server_base.cc:1034] running on GCE node
I20260811 02:36:59.894172 24525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:36:59.894485 24525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:36:59.895697 24525 hybrid_clock.cc:648] HybridClock initialized: now 1786415819895673 us; error 42 us; skew 500 ppm
Aug 11 02:36:59 dist-test-slave-7nm7 krb5kdc[24494](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415819, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:36:59.901254 24525 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:36:59.901710 24525 webserver.cc:460] Webserver started at http://127.17.79.62:46669/ using document root <none> and password file <none>
I20260811 02:36:59.901937 24525 fs_manager.cc:359] Metadata directory not provided
I20260811 02:36:59.902004 24525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:36:59.902168 24525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:36:59.903244 24525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "b3b44612ad024420a5b9d0bec7e3ba7a"
format_stamp: "Formatted at 2026-08-11 02:36:59 on dist-test-slave-7nm7"
server_key: "66d687f3841f33642da7e537f36f320b"
server_key_iv: "dc43087a3f3e12868f57584c9e1ebd2f"
server_key_version: "encryptionkey@0"
I20260811 02:36:59.903609 24525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "b3b44612ad024420a5b9d0bec7e3ba7a"
format_stamp: "Formatted at 2026-08-11 02:36:59 on dist-test-slave-7nm7"
server_key: "66d687f3841f33642da7e537f36f320b"
server_key_iv: "dc43087a3f3e12868f57584c9e1ebd2f"
server_key_version: "encryptionkey@0"
I20260811 02:36:59.905061 24525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:36:59.905840 24550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:36:59.906013 24525 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:36:59.906116 24525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "b3b44612ad024420a5b9d0bec7e3ba7a"
format_stamp: "Formatted at 2026-08-11 02:36:59 on dist-test-slave-7nm7"
server_key: "66d687f3841f33642da7e537f36f320b"
server_key_iv: "dc43087a3f3e12868f57584c9e1ebd2f"
server_key_version: "encryptionkey@0"
I20260811 02:36:59.906198 24525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:36:59.909443 24525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:36:59.911335 24525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:36:59.911490 24525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:36:59.915614 24525 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:36053
I20260811 02:36:59.915647 24637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:36053 every 8 connection(s)
I20260811 02:36:59.915971 24525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:36:59.916956 24639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:36:59.919363 24639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a: Bootstrap starting.
I20260811 02:36:59.919653 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24525
I20260811 02:36:59.919798 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:36:59.919986 17724 external_mini_cluster.cc:1428] Setting key 4cfcadd9ae35194e078dcf1dd9451821
I20260811 02:36:59.920125 24639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a: Neither blocks nor log segments found. Creating new log.
I20260811 02:36:59.920461 24639 log.cc:824] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a: Log is configured to *not* fsync() on all Append() calls
I20260811 02:36:59.921156 24639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a: No bootstrap required, opened a new log
I20260811 02:36:59.922606 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:59.920522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59991 (local address 127.17.79.62:36053)
0811 02:36:59.920739 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:59.920750 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:59.920803 (+ 53us) server_negotiation.cc:407] Connection header received
0811 02:36:59.921322 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:59.921329 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:59.921353 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:59.921500 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:59.922165 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:59.922168 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:59.922169 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:59.922173 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:59.922221 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:59.922285 (+ 64us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:59.922366 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:59.922405 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 02:36:59.922444 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":91,"threads_started":1}
I20260811 02:36:59.923666 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:36:59.923684 24639 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36053 } }
I20260811 02:36:59.923882 24639 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 02:36:59.923929 24639 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b44612ad024420a5b9d0bec7e3ba7a, State: Initialized, Role: FOLLOWER
I20260811 02:36:59.924057 24639 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36053 } }
I20260811 02:36:59.924150 24639 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 02:36:59.924193 24639 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 02:36:59.924242 24639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:36:59.924882 24639 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36053 } }
I20260811 02:36:59.924989 24639 leader_election.cc:302] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3b44612ad024420a5b9d0bec7e3ba7a; no voters:
I20260811 02:36:59.925325 24639 leader_election.cc:288] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 02:36:59.925411 24658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:36:59.925594 24658 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [term 1 LEADER]: Becoming Leader. State: Replica: b3b44612ad024420a5b9d0bec7e3ba7a, State: Running, Role: LEADER
I20260811 02:36:59.925633 24639 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:36:59.925719 24658 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36053 } }
I20260811 02:36:59.926015 24658 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3b44612ad024420a5b9d0bec7e3ba7a. Latest consensus state: current_term: 1 leader_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36053 } } }
I20260811 02:36:59.926103 24658 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:59.926132 24659 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3b44612ad024420a5b9d0bec7e3ba7a" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 36053 } } }
I20260811 02:36:59.926218 24659 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a [sys.catalog]: This master's current role is: LEADER
I20260811 02:36:59.926375 24644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:36:59.925287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56521 (local address 127.17.79.62:36053)
0811 02:36:59.925336 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 02:36:59.925338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:36:59.925347 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:36:59.925394 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:36:59.925395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:36:59.925400 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:36:59.925431 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:36:59.926105 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:36:59.926107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:36:59.926107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 02:36:59.926112 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:36:59.926125 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 02:36:59.926130 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:36:59.926175 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 02:36:59.926300 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 02:36:59.926315 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 02:36:59.927599 24684 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:36:59.927657 24684 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:36:59.927721 24665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:36:59.927909 24665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:36:59.929388 24665 catalog_manager.cc:1347] Generated new cluster ID: d37ff5c779a14105819136e34a0c2367
I20260811 02:36:59.929442 24665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:36:59.936842 24665 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:36:59.937023 24665 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:36:59.944356 24665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3b44612ad024420a5b9d0bec7e3ba7a: Generated new TSK 0
I20260811 02:36:59.944540 24665 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 02:36:59.949810 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24525
2026-08-11T02:36:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1592 ms)
[----------] 18 tests from AuthTokenIssuingTest (28884 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:37:00 dist-test-slave-7nm7 krb5kdc[24692](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:37:00 dist-test-slave-7nm7 krb5kdc[24692](info): set up 2 sockets
Aug 11 02:37:00 dist-test-slave-7nm7 krb5kdc[24692](info): commencing operation
krb5kdc: starting...
W20260811 02:37:01.259984 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:37:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:37:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:37:01.388568 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45647
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45647,127.17.79.61:45255,127.17.79.60:35707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:37:01.476509 24714 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 02:37:01.476783 24714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:37:01.476815 24714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:37:01.476876 24714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:37:01.478055 24714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:37:01.478127 24714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:37:01.478159 24714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:37:01.478178 24714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:37:01.478197 24714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:37:01.479753 24714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45647,127.17.79.61:45255,127.17.79.60:35707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:45647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:37:01.480055 24714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:37:01.480300 24714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:37:01.485550 24729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:01.485642 24722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:01.485642 24723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:37:01.486552 24714 server_base.cc:1034] running on GCE node
I20260811 02:37:01.486835 24714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:37:01.487320 24714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:37:01.488515 24714 hybrid_clock.cc:648] HybridClock initialized: now 1786415821488504 us; error 35 us; skew 500 ppm
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:37:01.491554 24714 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:37:01.492040 24714 webserver.cc:460] Webserver started at http://127.17.79.62:34963/ using document root <none> and password file <none>
I20260811 02:37:01.492290 24714 fs_manager.cc:359] Metadata directory not provided
I20260811 02:37:01.492337 24714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:37:01.492471 24714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:37:01.493546 24714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "eb71bd4238f84ab0ab0c02fe16559200"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "eca4f4f0744f181af75e927bc299b93f"
server_key_iv: "0b40e0d32f3e9310a7e4519a6698348b"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.493914 24714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "eb71bd4238f84ab0ab0c02fe16559200"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "eca4f4f0744f181af75e927bc299b93f"
server_key_iv: "0b40e0d32f3e9310a7e4519a6698348b"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.495461 24714 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:37:01.496343 24739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:37:01.496618 24714 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:37:01.496729 24714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "eb71bd4238f84ab0ab0c02fe16559200"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "eca4f4f0744f181af75e927bc299b93f"
server_key_iv: "0b40e0d32f3e9310a7e4519a6698348b"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.496814 24714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:37:01.510120 24714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:37:01.512472 24714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:37:01.512646 24714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:37:01.517419 24714 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:45647
I20260811 02:37:01.517472 24825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:45647 every 8 connection(s)
I20260811 02:37:01.517858 24714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:37:01.518980 24827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:37:01.520577 24827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:01.525688 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24714
I20260811 02:37:01.525825 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:37:01.526014 17724 external_mini_cluster.cc:1428] Setting key c68ededa5e653230dd74b851e8b39315
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:37:01.532377 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.521367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56958 (local address 127.17.79.62:45647)
0811 02:37:01.521562 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.521567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.521651 (+ 84us) server_negotiation.cc:407] Connection header received
0811 02:37:01.522214 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.522216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.522310 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.522404 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.523010 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.523959 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.524956 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.525284 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.525530 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.528649 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.528666 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.528666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.528673 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.530497 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.530924 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.530927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.530927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.531012 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.531401 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.531403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.531404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.531654 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.531766 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.531963 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.532112 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":117,"threads_started":1}
I20260811 02:37:01.532375 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.521311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45647 (local address 127.0.0.1:56958)
0811 02:37:01.521498 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.521543 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.522027 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.522440 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.522443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.522717 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.522887 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.522891 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.524084 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.524085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.524850 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.524852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.525541 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.525542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.525631 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.526484 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.526496 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.528537 (+ 2041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.530617 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.530623 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.530625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.530822 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.531102 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.531103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.531103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.531198 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.531744 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.531750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.531823 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.531928 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.532180 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":103,"thread_start_us":99,"threads_started":1}
I20260811 02:37:01.533741 24827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:01.534297 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.534015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32832)
0811 02:37:01.534155 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.534224 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 02:37:01.534446 24747 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
I20260811 02:37:01.534912 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.534814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32842)
0811 02:37:01.534864 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.534889 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 02:37:01.535023 24827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:45255: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.17.79.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab.
Entry for principal kudu/127.17.79.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab.
I20260811 02:37:01.556715 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:45255
--webserver_interface=127.17.79.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab
--principal=kudu/127.17.79.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45647,127.17.79.61:45255,127.17.79.60:35707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:37:01.584271 24827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } attempt: 1
I20260811 02:37:01.584837 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.584654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32852)
0811 02:37:01.584733 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.584794 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 02:37:01.585232 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.585132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32858)
0811 02:37:01.585181 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.585209 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 02:37:01.585361 24827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:45255: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
W20260811 02:37:01.639240 24836 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 02:37:01.639451 24836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:37:01.639469 24836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:37:01.639489 24836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:37:01.640619 24836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:37:01.640671 24836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:37:01.640686 24836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:37:01.640698 24836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:37:01.640710 24836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:37:01.642292 24836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45647,127.17.79.61:45255,127.17.79.60:35707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab
--principal=kudu/127.17.79.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:45255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.79.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:37:01.642570 24836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:37:01.642814 24836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:37:01.647856 24845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:01.647866 24843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:37:01.648013 24836 server_base.cc:1034] running on GCE node
W20260811 02:37:01.647866 24849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:37:01.648370 24836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:37:01.648675 24836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:37:01.649856 24836 hybrid_clock.cc:648] HybridClock initialized: now 1786415821649849 us; error 36 us; skew 500 ppm
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:37:01.652525 24836 init.cc:377] Logged in from keytab as kudu/127.17.79.61@KRBTEST.COM (short username kudu)
I20260811 02:37:01.653040 24836 webserver.cc:460] Webserver started at http://127.17.79.61:46019/ using document root <none> and password file <none>
I20260811 02:37:01.653283 24836 fs_manager.cc:359] Metadata directory not provided
I20260811 02:37:01.653350 24836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:37:01.653486 24836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:37:01.653522 24827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } attempt: 2
I20260811 02:37:01.653940 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.653825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32864)
0811 02:37:01.653881 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.653915 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 02:37:01.654326 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.654193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32880)
0811 02:37:01.654271 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.654307 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 02:37:01.654414 24827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:45255: Network error: Client connection negotiation failed: client connection to 127.17.79.61:45255: connect: Connection refused (error 111)
I20260811 02:37:01.654843 24836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data/instance:
uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "70f59c259c03afdb73f2e7760bb763d6"
server_key_iv: "5921beef484ab4eb9de958336933f436"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.655211 24836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/wal/instance:
uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "70f59c259c03afdb73f2e7760bb763d6"
server_key_iv: "5921beef484ab4eb9de958336933f436"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.656587 24836 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 02:37:01.657373 24859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:37:01.657564 24836 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:37:01.657676 24836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/wal
uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "70f59c259c03afdb73f2e7760bb763d6"
server_key_iv: "5921beef484ab4eb9de958336933f436"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.657759 24836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:37:01.679997 24836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:37:01.682628 24836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:37:01.682844 24836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:37:01.687263 24836 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.61:45255
I20260811 02:37:01.687319 24951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.61:45255 every 8 connection(s)
I20260811 02:37:01.687706 24836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
I20260811 02:37:01.688755 24952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:37:01.690317 24952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:01.693176 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24836
I20260811 02:37:01.693302 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-1/wal/instance
I20260811 02:37:01.693482 17724 external_mini_cluster.cc:1428] Setting key 5adfb60fb62985f159d8cd5c219d49fc
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:37:01.701143 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.691299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56968 (local address 127.17.79.62:45647)
0811 02:37:01.691376 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.691379 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.691685 (+ 306us) server_negotiation.cc:407] Connection header received
0811 02:37:01.692187 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.692189 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.692204 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.692293 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.693052 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.693833 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.694856 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.695209 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.695289 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.697670 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.697672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.697672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.697680 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.699473 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.699879 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.699880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.699881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.699951 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.700344 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.700346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.700346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.700496 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.700577 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.700934 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.701033 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 02:37:01.701180 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.691298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45647 (local address 127.0.0.1:56968)
0811 02:37:01.691548 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.691595 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.692057 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.692506 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.692510 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.692754 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.692941 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.692945 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.693926 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.693927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.694772 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.694775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.695323 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.695325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.695491 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.696004 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.696015 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.697571 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.699575 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.699581 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.699583 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.699804 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.700069 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.700070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.700070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.700263 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.700596 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.700604 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.700742 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.700836 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.701002 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":101,"threads_started":1}
I20260811 02:37:01.701786 24952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.79.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.60@KRBTEST.COM" created.
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:37:01.709429 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.702068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32892)
0811 02:37:01.702305 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.702316 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.702368 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.702506 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.702507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.702647 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.702690 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.702691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.703592 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.703593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.704227 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.704229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.704726 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.704727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.704805 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.705250 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.705255 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.706507 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.708295 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.708296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.708296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.708518 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.708718 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.708719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.708719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.708789 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.709142 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.709143 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.709186 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.709265 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.709356 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 02:37:01.709708 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.702157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32892 (local address 127.17.79.61:45255)
0811 02:37:01.702318 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.702323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.702366 (+ 43us) server_negotiation.cc:407] Connection header received
0811 02:37:01.702426 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.702428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.702442 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.702507 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.702778 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.703493 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.704313 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.704636 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.704726 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.706591 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.706600 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.706600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.706608 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.708210 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.708600 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.708602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.708603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.708652 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.708850 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.708851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.708851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.708976 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.709117 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.709563 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.709638 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":106,"threads_started":1}
I20260811 02:37:01.710307 24952 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:01.710650 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.710533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57832)
0811 02:37:01.710580 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.710624 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 02:37:01.710769 24862 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
I20260811 02:37:01.711193 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.711100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57834)
0811 02:37:01.711149 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.711173 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 02:37:01.711300 24952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35707: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab.
Entry for principal kudu/127.17.79.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab.
I20260811 02:37:01.721750 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:35707
--webserver_interface=127.17.79.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab
--principal=kudu/127.17.79.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:40021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:45647,127.17.79.61:45255,127.17.79.60:35707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:37:01.745576 24827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } attempt: 3
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:37:01.753959 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.745968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32906)
0811 02:37:01.746032 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.746045 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.746125 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.746313 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.746314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.746479 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.746558 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.746560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.747473 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.747474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.748225 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.748228 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.748608 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.748609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.748690 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.749423 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.749432 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.751248 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.752871 (+ 1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.752873 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.752873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.753057 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.753280 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.753281 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.753281 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.753348 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.753615 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.753616 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.753664 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.753752 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.753858 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 02:37:01.753959 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.746057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32906 (local address 127.17.79.61:45255)
0811 02:37:01.746135 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.746137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.746167 (+ 30us) server_negotiation.cc:407] Connection header received
0811 02:37:01.746196 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.746197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.746207 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.746302 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.746646 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.747353 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.748315 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.748527 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.748609 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.751362 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.751364 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.751364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.751372 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.752778 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.753148 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.753149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.753150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.753211 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.753420 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.753421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.753421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.753540 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.753611 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.753776 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.753859 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 02:37:01.754485 24827 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:01.754824 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.754740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57838)
0811 02:37:01.754778 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.754807 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 02:37:01.755282 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.755037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57844)
0811 02:37:01.755083 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.755235 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 02:37:01.755522 24827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35707: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
I20260811 02:37:01.760529 24952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } attempt: 1
I20260811 02:37:01.760941 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.760818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57852)
0811 02:37:01.760874 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.760906 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 02:37:01.761291 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.761165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57854)
0811 02:37:01.761219 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.761249 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 02:37:01.761390 24952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35707: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
I20260811 02:37:01.786733 24827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } attempt: 1
I20260811 02:37:01.787295 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.787129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57858)
0811 02:37:01.787203 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.787251 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 02:37:01.787904 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.787629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57864)
0811 02:37:01.787757 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.787881 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 02:37:01.788074 24827 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35707: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
W20260811 02:37:01.808350 24965 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 02:37:01.808570 24965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:37:01.808588 24965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:37:01.808609 24965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:37:01.809882 24965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:37:01.809931 24965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:37:01.809947 24965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:37:01.809959 24965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:37:01.809973 24965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:37:01.811568 24965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:40021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:45647,127.17.79.61:45255,127.17.79.60:35707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab
--principal=kudu/127.17.79.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:35707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.79.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:37:01.811825 24965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:37:01.812078 24965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:37:01.817624 24972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:01.817642 24975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:01.817620 24979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:37:01.817925 24965 server_base.cc:1034] running on GCE node
I20260811 02:37:01.818562 24965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:37:01.818858 24965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:37:01.820073 24965 hybrid_clock.cc:648] HybridClock initialized: now 1786415821819994 us; error 70 us; skew 500 ppm
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:37:01.823963 24965 init.cc:377] Logged in from keytab as kudu/127.17.79.60@KRBTEST.COM (short username kudu)
I20260811 02:37:01.824852 24965 webserver.cc:460] Webserver started at http://127.17.79.60:36289/ using document root <none> and password file <none>
I20260811 02:37:01.825220 24965 fs_manager.cc:359] Metadata directory not provided
I20260811 02:37:01.825388 24965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:37:01.825528 24965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:37:01.826735 24965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data/instance:
uuid: "a2b9ede219e64114a6c46b0e8e02f662"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "8ac199d4c00f1c0863fc2159cc91d970"
server_key_iv: "c515fd614825e13fff8653714fa63dde"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.827059 24965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/wal/instance:
uuid: "a2b9ede219e64114a6c46b0e8e02f662"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "8ac199d4c00f1c0863fc2159cc91d970"
server_key_iv: "c515fd614825e13fff8653714fa63dde"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.829113 24965 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 02:37:01.829559 24952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } attempt: 2
I20260811 02:37:01.830349 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.830055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57878)
0811 02:37:01.830214 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.830303 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260811 02:37:01.830406 24991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:37:01.830595 24965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:37:01.830694 24965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/wal
uuid: "a2b9ede219e64114a6c46b0e8e02f662"
format_stamp: "Formatted at 2026-08-11 02:37:01 on dist-test-slave-7nm7"
server_key: "8ac199d4c00f1c0863fc2159cc91d970"
server_key_iv: "c515fd614825e13fff8653714fa63dde"
server_key_version: "encryptionkey@0"
I20260811 02:37:01.830786 24965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:37:01.830968 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.830750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57894)
0811 02:37:01.830886 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.830934 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 02:37:01.831179 24952 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35707: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35707: connect: Connection refused (error 111)
I20260811 02:37:01.838925 24965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:37:01.841545 24965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:37:01.841675 24965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:37:01.847064 24965 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.60:35707
I20260811 02:37:01.847138 25081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.60:35707 every 8 connection(s)
I20260811 02:37:01.847791 24965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
I20260811 02:37:01.849001 25083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:37:01.850807 25083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:37:01.857965 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 24965
I20260811 02:37:01.858139 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786415535404356-17724-0/minicluster-data/master-2/wal/instance
I20260811 02:37:01.858390 17724 external_mini_cluster.cc:1428] Setting key a0ebb3feea25362249d60b73e6bbf35a
I20260811 02:37:01.861603 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.851636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56980 (local address 127.17.79.62:45647)
0811 02:37:01.851742 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.851744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.852027 (+ 283us) server_negotiation.cc:407] Connection header received
0811 02:37:01.852515 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.852518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.852536 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.852637 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.853418 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.853927 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.855031 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.855229 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.855325 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.857693 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.857695 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.857695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.857701 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.859780 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.860380 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.860381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.860381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.860504 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.860855 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.860856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.860857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.860985 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.861113 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.861415 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.861500 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 02:37:01.861835 25085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.851564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:45647 (local address 127.0.0.1:56980)
0811 02:37:01.851842 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.851880 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.852349 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.852740 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.852744 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.853007 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.853248 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.853252 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.854027 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.854028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.854935 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.854937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.855361 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.855362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.855471 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.855980 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.855989 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.857589 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.859919 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.859928 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.859930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.860274 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.860579 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.860580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.860580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.860742 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.861103 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.861110 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.861254 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.861367 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.861491 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":155,"threads_started":1}
I20260811 02:37:01.862489 25083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:01.863236 24827 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } attempt: 2
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:37:01.871521 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.859059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57900 (local address 127.17.79.60:35707)
0811 02:37:01.859241 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.859246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.860164 (+ 918us) server_negotiation.cc:407] Connection header received
0811 02:37:01.860194 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.860197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.860214 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.860317 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.861082 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.862182 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.863294 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.863811 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.863914 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.867110 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.867120 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.867120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.867128 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.870018 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.870505 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.870509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.870509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.870583 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.870851 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.870852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.870852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.871048 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.871208 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.871270 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.871401 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
I20260811 02:37:01.871614 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.862977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32922 (local address 127.17.79.61:45255)
0811 02:37:01.863050 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.863052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.863060 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:37:01.863086 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.863087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.863097 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.863153 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.863573 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.864210 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.864995 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.865306 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.865454 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.868612 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.868613 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.868613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.868620 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.870222 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.870743 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.870744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.870744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.870799 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.871042 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.871043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.871043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.871186 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.871249 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.871435 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.871507 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 02:37:01.871968 25085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.862771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:45255 (local address 127.0.0.1:32922)
0811 02:37:01.862812 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.862821 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.862852 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.863226 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.863228 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.863411 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.863469 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.863471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.864307 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.864307 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.864844 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.864846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.865479 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.865480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.865565 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.866509 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.866514 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.868526 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.870400 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.870402 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.870402 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.870633 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.870896 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.870897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.870897 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.870965 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.871278 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.871279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.871312 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.871783 (+ 471us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.871877 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 02:37:01.872540 25083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:01.873620 24829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.863502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57904)
0811 02:37:01.863547 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.863557 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.863596 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.863840 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.863841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.864006 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.864052 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.864054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.865063 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.865064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.865924 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.865928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.866659 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.866661 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.866725 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.867148 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.867153 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.868415 (+ 1262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.871779 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.871781 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.871781 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.871989 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.872579 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.872580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.872581 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.872680 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.872995 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.872996 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.873061 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.873257 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.873483 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 02:37:01.874184 25090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.863542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57904 (local address 127.17.79.60:35707)
0811 02:37:01.863713 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.863715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.863721 (+ 6us) server_negotiation.cc:407] Connection header received
0811 02:37:01.863738 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.863739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.863750 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.863835 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.864146 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.864947 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.866026 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.866540 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.866865 (+ 325us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.868592 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.868595 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.868596 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.868610 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.871666 (+ 3056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.872080 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.872081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.872091 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.872304 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.872763 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.872763 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.872764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.872905 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.873914 (+ 1009us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.873959 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.874056 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":125,"threads_started":1}
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:37:01.877087 24827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200: Bootstrap starting.
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:37:01.877810 24827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200: Neither blocks nor log segments found. Creating new log.
I20260811 02:37:01.878139 24827 log.cc:824] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200: Log is configured to *not* fsync() on all Append() calls
I20260811 02:37:01.879289 24827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200: No bootstrap required, opened a new log
I20260811 02:37:01.880515 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.872556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56986 (local address 127.17.79.62:45647)
0811 02:37:01.872593 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.872595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.872604 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:37:01.872670 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.872671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.872681 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.872737 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.873346 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.873906 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.874870 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.875113 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.875179 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.877574 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.877575 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.877576 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.877583 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.879292 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.879686 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.879688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.879688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.879750 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.879967 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.879968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.879968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.880101 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.880260 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.880346 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.880425 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:37:01.881055 25085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.872779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57910)
0811 02:37:01.872858 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.872867 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.872902 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.873026 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.873027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.873188 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.873227 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.873229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.874609 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.874610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.875293 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.875296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.875736 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.875737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.875787 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.876241 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.876246 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.877954 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.879977 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.879978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.879978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.880134 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.880332 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.880333 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.880333 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.880379 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.880717 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.880717 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.880756 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.880844 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.880944 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 02:37:01.881107 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.872890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57910 (local address 127.17.79.60:35707)
0811 02:37:01.872931 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.872933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.872940 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:37:01.872959 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.872960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.872971 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.873022 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.873356 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.874532 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.875383 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.875648 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.875720 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.878369 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.878370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.878371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.878377 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.879899 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.880223 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.880224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.880224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.880271 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.880437 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.880438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.880438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.880616 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.880712 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.880867 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.880993 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":24}
I20260811 02:37:01.882133 24827 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.882311 24827 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb71bd4238f84ab0ab0c02fe16559200, State: Initialized, Role: FOLLOWER
I20260811 02:37:01.882411 24827 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.882787 24827 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:37:01.882855 25083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: Bootstrap starting.
I20260811 02:37:01.883673 25083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: Neither blocks nor log segments found. Creating new log.
I20260811 02:37:01.884011 25083 log.cc:824] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: Log is configured to *not* fsync() on all Append() calls
W20260811 02:37:01.884765 25112 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:37:01.884815 25112 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:37:01.884925 25092 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.885002 25092 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:01.885427 25083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: No bootstrap required, opened a new log
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:37:01.887529 25083 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.887663 25083 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2b9ede219e64114a6c46b0e8e02f662, State: Initialized, Role: FOLLOWER
I20260811 02:37:01.887733 25083 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.885598 24714 master_runner.cc:186] Error getting master registration for 127.17.79.61:45255: OK, instance_id { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" instance_seqno: 1786415821685938 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 02:37:01.888018 24714 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 02:37:01.888026 25083 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:37:01.889091 25119 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.889218 25119 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 02:37:01.891093 25137 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:37:01.891167 25137 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:37:01.891878 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.881134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32938 (local address 127.17.79.61:45255)
0811 02:37:01.881184 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.881187 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.882436 (+ 1249us) server_negotiation.cc:407] Connection header received
0811 02:37:01.882514 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.882515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.882526 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.882571 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.883140 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.883796 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.884738 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.885056 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.885124 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.888152 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.888153 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.888154 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.888162 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.889733 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.890113 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.890114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.890115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.890174 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.890417 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.890418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.890419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.890564 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.890725 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.891678 (+ 953us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.891768 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 02:37:01.893579 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:37:01.894747 24785 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "eb71bd4238f84ab0ab0c02fe16559200"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56986
I20260811 02:37:01.894867 24785 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 02:37:01.894912 24785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:37:01.892923 24965 master_runner.cc:186] Error getting master registration for 127.17.79.61:45255: OK, instance_id { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" instance_seqno: 1786415821685938 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 02:37:01.895207 24965 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 02:37:01.895934 24785 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.896167 24785 leader_election.cc:288] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [CANDIDATE]: Term 1 election: Requested vote from peers b24a5d49e4f94aa0ab5dacfc4a94ec37 (127.17.79.61:45255), a2b9ede219e64114a6c46b0e8e02f662 (127.17.79.60:35707)
I20260811 02:37:01.896481 25041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb71bd4238f84ab0ab0c02fe16559200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a2b9ede219e64114a6c46b0e8e02f662"
I20260811 02:37:01.896593 25041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:37:01.897987 25041 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb71bd4238f84ab0ab0c02fe16559200 in term 1.
I20260811 02:37:01.898191 24747 leader_election.cc:302] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2b9ede219e64114a6c46b0e8e02f662, eb71bd4238f84ab0ab0c02fe16559200; no voters:
I20260811 02:37:01.898340 25092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:37:01.898550 25092 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [term 1 LEADER]: Becoming Leader. State: Replica: eb71bd4238f84ab0ab0c02fe16559200, State: Running, Role: LEADER
I20260811 02:37:01.898662 25092 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.899168 25148 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb71bd4238f84ab0ab0c02fe16559200. Latest consensus state: current_term: 1 leader_uuid: "eb71bd4238f84ab0ab0c02fe16559200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.899384 25148 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: This master's current role is: LEADER
I20260811 02:37:01.899680 25151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:37:01.899889 25151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:37:01.901434 25041 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [term 1 FOLLOWER]: Refusing update from remote peer eb71bd4238f84ab0ab0c02fe16559200: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:37:01.901901 25148 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:37:01.903223 25119 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb71bd4238f84ab0ab0c02fe16559200. Latest consensus state: current_term: 1 leader_uuid: "eb71bd4238f84ab0ab0c02fe16559200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.903327 25119 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:01.915378 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.897757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57916 (local address 127.17.79.60:35707)
0811 02:37:01.897793 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.897794 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.906701 (+ 8907us) server_negotiation.cc:407] Connection header received
0811 02:37:01.906798 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.906800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.906809 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.906861 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.907596 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.908359 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.909414 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.909770 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.909813 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.911504 (+ 1691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.911505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.911506 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.911513 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.913450 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.913953 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.913954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.913955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.914016 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.914226 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.914249 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.914249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.914378 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.914448 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.914922 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.915007 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:37:01.918450 24958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.897578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32946 (local address 127.17.79.61:45255)
0811 02:37:01.897624 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.897626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.906532 (+ 8906us) server_negotiation.cc:407] Connection header received
0811 02:37:01.906602 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.906603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.906616 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.906686 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.908099 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.909115 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.911207 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.911659 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.911721 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.914173 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.914175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.914175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.914183 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.915982 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.917276 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.917277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.917277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.917351 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.917656 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.917657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.917658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.917814 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.917886 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.918263 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.918357 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 02:37:01.918898 25148 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb71bd4238f84ab0ab0c02fe16559200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.919014 25148 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: This master's current role is: LEADER
I20260811 02:37:01.919106 25153 mvcc.cc:205] Tried to move back new op lower bound from 7317159206506082304 to 7317159206497746944. Current Snapshot: MvccSnapshot[applied={T|T < 7317159206506082304}]
I20260811 02:37:01.919718 25119 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb71bd4238f84ab0ab0c02fe16559200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.919819 25119 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:01.920013 25154 mvcc.cc:205] Tried to move back new op lower bound from 7317159206506082304 to 7317159206497746944. Current Snapshot: MvccSnapshot[applied={T|T < 7317159206506082304}]
I20260811 02:37:01.921015 25151 catalog_manager.cc:1347] Generated new cluster ID: f353fe126d614f8889d76ad4e720fec1
I20260811 02:37:01.921073 25151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:37:01.922338 24952 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } attempt: 3
Aug 11 02:37:01 dist-test-slave-7nm7 krb5kdc[24692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415821, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:37:01.930184 24955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.922569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35707 (local address 127.0.0.1:57924)
0811 02:37:01.922611 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:01.922620 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:01.922651 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:01.922796 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:01.922797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:01.922939 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:01.922978 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.922979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.923844 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.923845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.924605 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:01.924606 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.925084 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.925085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:01.925137 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.925520 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:01.925525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:01.926932 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:01.929118 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.929119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.929119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.929314 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.929505 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:01.929506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:01.929506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:01.929555 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:01.929869 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:01.929870 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:01.929915 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 02:37:01.929980 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 02:37:01.930080 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 02:37:01.930841 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.922623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57924 (local address 127.17.79.60:35707)
0811 02:37:01.922661 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.922662 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.922696 (+ 34us) server_negotiation.cc:407] Connection header received
0811 02:37:01.922723 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.922724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.922734 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.922793 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.923041 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.923765 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.924679 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.925007 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.925086 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.927022 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.927023 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.927023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.927031 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.929033 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.929394 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.929395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.929395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.929444 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.929629 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.929631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.929631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.929776 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.929837 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.930670 (+ 833us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.930748 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:37:01.931485 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:01.909812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56992 (local address 127.17.79.62:45647)
0811 02:37:01.909854 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.909857 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.915859 (+ 6002us) server_negotiation.cc:407] Connection header received
0811 02:37:01.915960 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.915961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.915973 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.916003 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.916555 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.917284 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.918295 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:01.918591 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:01.918630 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:01.920326 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:01.920327 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:01.920327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:01.920335 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:01.921963 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.930616 (+ 8653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.930617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.930618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.930685 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:01.930890 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:01.930891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:01.930891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:01.931014 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:01.931093 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:01.931308 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 02:37:01.931392 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:37:01.933306 24952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37: Bootstrap starting.
I20260811 02:37:01.934352 24952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37: Neither blocks nor log segments found. Creating new log.
I20260811 02:37:01.934674 24952 log.cc:824] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37: Log is configured to *not* fsync() on all Append() calls
I20260811 02:37:01.936527 24952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37: No bootstrap required, opened a new log
I20260811 02:37:01.938706 24952 raft_consensus.cc:348] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.938839 24952 raft_consensus.cc:729] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b24a5d49e4f94aa0ab5dacfc4a94ec37, State: Initialized, Role: FOLLOWER
I20260811 02:37:01.938911 24952 consensus_queue.cc:260] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } }
I20260811 02:37:01.939253 24952 sys_catalog.cc:564] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:37:01.939320 24898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:37:01.940460 24898 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [term 1 FOLLOWER]: Refusing update from remote peer eb71bd4238f84ab0ab0c02fe16559200: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:37:01.940779 25148 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:37:01.939251 25166 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.939327 24899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "eb71bd4238f84ab0ab0c02fe16559200" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37"
I20260811 02:37:01.943056 24899 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb71bd4238f84ab0ab0c02fe16559200 in term 1.
I20260811 02:37:01.943143 25166 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:01.946269 25151 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:37:01.946645 25166 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb71bd4238f84ab0ab0c02fe16559200. Latest consensus state: current_term: 1 leader_uuid: "eb71bd4238f84ab0ab0c02fe16559200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.946727 25166 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:01.946758 25166 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb71bd4238f84ab0ab0c02fe16559200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.946796 25166 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:01.947105 25151 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:37:01.948282 25193 catalog_manager.cc:1259] Loaded cluster ID: f353fe126d614f8889d76ad4e720fec1
I20260811 02:37:01.948329 25193 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37: loading cluster ID for follower catalog manager: success
I20260811 02:37:01.949568 25193 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37: acquiring CA information for follower catalog manager: success
W20260811 02:37:01.949728 25193 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260811 02:37:01.950094 25148 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb71bd4238f84ab0ab0c02fe16559200" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb71bd4238f84ab0ab0c02fe16559200" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 45647 } } peers { permanent_uuid: "b24a5d49e4f94aa0ab5dacfc4a94ec37" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 45255 } } peers { permanent_uuid: "a2b9ede219e64114a6c46b0e8e02f662" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35707 } } }
I20260811 02:37:01.950204 25148 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200 [sys.catalog]: This master's current role is: LEADER
I20260811 02:37:01.951212 25151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb71bd4238f84ab0ab0c02fe16559200: Generated new TSK 0
I20260811 02:37:01.951382 25151 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 02:37:01.981467 24832 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:01.979841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57000 (local address 127.17.79.62:45647)
0811 02:37:01.979888 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.979891 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.980788 (+ 897us) server_negotiation.cc:407] Connection header received
0811 02:37:01.980901 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.980902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.980913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.980945 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.981394 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57000: BlockingRecv error: recv got EOF from 127.0.0.1:57000 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 02:37:01.982414 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:01.980050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32950 (local address 127.17.79.61:45255)
0811 02:37:01.980091 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.980093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.981887 (+ 1794us) server_negotiation.cc:407] Connection header received
0811 02:37:01.981983 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.981984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.981994 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.982024 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.982356 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32950: BlockingRecv error: recv got EOF from 127.0.0.1:32950 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 02:37:01.983320 25089 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:01.980517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57938 (local address 127.17.79.60:35707)
0811 02:37:01.980567 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.980569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.982826 (+ 2257us) server_negotiation.cc:407] Connection header received
0811 02:37:01.982922 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.982923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.982932 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.982961 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.983262 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57938: BlockingRecv error: recv got EOF from 127.0.0.1:57938 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 02:37:01.985826 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:01.985050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32958 (local address 127.17.79.61:45255)
0811 02:37:01.985086 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.985088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.985315 (+ 227us) server_negotiation.cc:407] Connection header received
0811 02:37:01.985419 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.985420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.985436 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.985465 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.985780 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32958: BlockingRecv error: recv got EOF from 127.0.0.1:32958 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 02:37:01.988884 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:01.988109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32970 (local address 127.17.79.61:45255)
0811 02:37:01.988142 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.988144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.988383 (+ 239us) server_negotiation.cc:407] Connection header received
0811 02:37:01.988477 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.988477 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.988487 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.988516 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.988842 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32970: BlockingRecv error: recv got EOF from 127.0.0.1:32970 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 02:37:01.992801 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:01.992039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32980 (local address 127.17.79.61:45255)
0811 02:37:01.992074 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.992075 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.992317 (+ 242us) server_negotiation.cc:407] Connection header received
0811 02:37:01.992407 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.992408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.992417 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.992444 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:01.992756 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32980: BlockingRecv error: recv got EOF from 127.0.0.1:32980 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 02:37:02.000192 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:01.999263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32994 (local address 127.17.79.61:45255)
0811 02:37:01.999301 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:01.999303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:01.999573 (+ 270us) server_negotiation.cc:407] Connection header received
0811 02:37:01.999677 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:01.999678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:01.999690 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:01.999735 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:02.000144 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32994: BlockingRecv error: recv got EOF from 127.0.0.1:32994 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 02:37:02.010667 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:02.009587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32998 (local address 127.17.79.61:45255)
0811 02:37:02.009630 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:02.009632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:02.010006 (+ 374us) server_negotiation.cc:407] Connection header received
0811 02:37:02.010135 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:02.010136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:02.010148 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:02.010190 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:02.010610 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32998: BlockingRecv error: recv got EOF from 127.0.0.1:32998 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 02:37:02.028962 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:02.028029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33014 (local address 127.17.79.61:45255)
0811 02:37:02.028071 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:02.028073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:02.028375 (+ 302us) server_negotiation.cc:407] Connection header received
0811 02:37:02.028484 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:02.028485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:02.028498 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:02.028534 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:02.028906 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33014: BlockingRecv error: recv got EOF from 127.0.0.1:33014 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 02:37:02.063460 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:02.062491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33030 (local address 127.17.79.61:45255)
0811 02:37:02.062539 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:02.062541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:02.062838 (+ 297us) server_negotiation.cc:407] Connection header received
0811 02:37:02.062941 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:02.062942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:02.062955 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:02.062987 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:02.063397 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33030: BlockingRecv error: recv got EOF from 127.0.0.1:33030 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 02:37:02.130349 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:02.129265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33044 (local address 127.17.79.61:45255)
0811 02:37:02.129362 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:02.129365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:02.129505 (+ 140us) server_negotiation.cc:407] Connection header received
0811 02:37:02.129594 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:02.129595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:02.129607 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:02.129684 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:02.130035 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33044: BlockingRecv error: recv got EOF from 127.0.0.1:33044 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 02:37:02.261183 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:02.260022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33060 (local address 127.17.79.61:45255)
0811 02:37:02.260162 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:02.260164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:02.260184 (+ 20us) server_negotiation.cc:407] Connection header received
0811 02:37:02.260334 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:02.260336 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:02.260350 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:02.260433 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:02.261018 (+ 585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33060: BlockingRecv error: recv got EOF from 127.0.0.1:33060 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 02:37:02.519356 24958 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:02.518556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33074 (local address 127.17.79.61:45255)
0811 02:37:02.518637 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:02.518639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:02.518648 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:37:02.518676 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:02.518677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:02.518687 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:02.518752 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:02.519296 (+ 544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33074: BlockingRecv error: recv got EOF from 127.0.0.1:33074 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 02:37:02.891710 25137 catalog_manager.cc:1259] Loaded cluster ID: f353fe126d614f8889d76ad4e720fec1
I20260811 02:37:02.891811 25137 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: loading cluster ID for follower catalog manager: success
I20260811 02:37:02.893163 25137 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: acquiring CA information for follower catalog manager: success
I20260811 02:37:02.893507 25137 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2b9ede219e64114a6c46b0e8e02f662: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 02:37:02.950452 25193 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b24a5d49e4f94aa0ab5dacfc4a94ec37: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 02:37:03.035413 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:03.032485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33086 (local address 127.17.79.61:45255)
0811 02:37:03.032631 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:03.032633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:03.032681 (+ 48us) server_negotiation.cc:407] Connection header received
0811 02:37:03.032732 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:03.032733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:03.032784 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:03.032861 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:03.032986 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.033603 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.034501 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.034764 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.034829 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:03.034999 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:03.035130 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:03.035192 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:03.035244 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 02:37:03.035262 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260811 02:37:03.040307 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:03.037576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57942 (local address 127.17.79.60:35707)
0811 02:37:03.037739 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:03.037741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:03.037750 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:37:03.037828 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:03.037829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:03.037864 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:03.037937 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:03.038101 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.038644 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.039382 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.039693 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.039757 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:03.039924 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:03.040025 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:03.040098 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:03.040154 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 02:37:03.040173 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
I20260811 02:37:03.045399 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:03.042096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33102 (local address 127.17.79.61:45255)
0811 02:37:03.042155 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:03.042157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:03.042388 (+ 231us) server_negotiation.cc:407] Connection header received
0811 02:37:03.042515 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:03.042516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:03.042531 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:03.042593 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:03.042790 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.043317 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.044465 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.044777 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.044842 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:03.044996 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:03.045037 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:03.045100 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:03.045172 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 02:37:03.045196 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 02:37:03.045738 25336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:03.042192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57010 (local address 127.17.79.62:45647)
0811 02:37:03.042343 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:03.042345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:03.042355 (+ 10us) server_negotiation.cc:407] Connection header received
0811 02:37:03.042403 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:03.042404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:03.042458 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:03.042545 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:03.042708 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.043620 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.044358 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.044662 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.044730 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:03.044963 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:03.045072 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:03.045276 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:03.045636 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 02:37:03.045663 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260811 02:37:03.045825 25323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:03.042329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57944 (local address 127.17.79.60:35707)
0811 02:37:03.042368 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:03.042369 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:03.042515 (+ 146us) server_negotiation.cc:407] Connection header received
0811 02:37:03.042576 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:03.042577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:03.042589 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:03.042641 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:03.042746 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.043450 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.044869 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:03.045251 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:03.045330 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:03.045518 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:03.045554 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:03.045615 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:03.045706 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 02:37:03.045728 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 02:37:03.047444 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24714
I20260811 02:37:03.062122 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24836
I20260811 02:37:03.073412 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 24965
2026-08-11T02:37:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3126 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 02:37:03 dist-test-slave-7nm7 krb5kdc[25346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 02:37:03 dist-test-slave-7nm7 krb5kdc[25346](info): set up 2 sockets
Aug 11 02:37:03 dist-test-slave-7nm7 krb5kdc[25346](info): commencing operation
krb5kdc: starting...
W20260811 02:37:04.395357 17724 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/test-user.keytab.
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T02:37:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T02:37:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.79.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
Entry for principal kudu/127.17.79.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab.
I20260811 02:37:04.518409 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43571
--webserver_interface=127.17.79.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43571,127.17.79.61:44701,127.17.79.60:35565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 02:37:04.601945 25366 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 02:37:04.602217 25366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:37:04.602245 25366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:37:04.602300 25366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:37:04.603462 25366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:37:04.603535 25366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:37:04.603561 25366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:37:04.603591 25366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:37:04.603632 25366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:37:04.605202 25366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43571,127.17.79.61:44701,127.17.79.60:35565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.62.keytab
--principal=kudu/127.17.79.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.62:43571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.79.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:37:04.605500 25366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:37:04.605746 25366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:37:04.610759 25376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:04.610761 25378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:04.610755 25375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:37:04.611112 25366 server_base.cc:1034] running on GCE node
I20260811 02:37:04.611358 25366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:37:04.611653 25366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:37:04.612929 25366 hybrid_clock.cc:648] HybridClock initialized: now 1786415824612912 us; error 49 us; skew 500 ppm
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:37:04.616083 25366 init.cc:377] Logged in from keytab as kudu/127.17.79.62@KRBTEST.COM (short username kudu)
I20260811 02:37:04.616535 25366 webserver.cc:460] Webserver started at http://127.17.79.62:33511/ using document root <none> and password file <none>
I20260811 02:37:04.616777 25366 fs_manager.cc:359] Metadata directory not provided
I20260811 02:37:04.616823 25366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:37:04.616967 25366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:37:04.618057 25366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data/instance:
uuid: "6404109cc53c4adbb45a679237b72316"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "38a26543d4917611a818c40dc79ec66e"
server_key_iv: "9ae9a22769a1f1724a40a772191d738a"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.618472 25366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/wal/instance:
uuid: "6404109cc53c4adbb45a679237b72316"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "38a26543d4917611a818c40dc79ec66e"
server_key_iv: "9ae9a22769a1f1724a40a772191d738a"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.620055 25366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 02:37:04.620843 25388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:37:04.621048 25366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 02:37:04.621160 25366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/wal
uuid: "6404109cc53c4adbb45a679237b72316"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "38a26543d4917611a818c40dc79ec66e"
server_key_iv: "9ae9a22769a1f1724a40a772191d738a"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.621236 25366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:37:04.653182 25366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:37:04.655247 25366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:37:04.655426 25366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:37:04.659986 25366 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.62:43571
I20260811 02:37:04.660040 25477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.62:43571 every 8 connection(s)
I20260811 02:37:04.660413 25366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/data/info.pb
I20260811 02:37:04.661420 25478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:37:04.662969 25478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:04.664124 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 25366
I20260811 02:37:04.664255 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-0/wal/instance
I20260811 02:37:04.664520 17724 external_mini_cluster.cc:1428] Setting key 12884f69febb5c3b8232ee27edb4ec44
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.79.61@KRBTEST.COM; defaulting to no policy
I20260811 02:37:04.673867 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.663623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43571 (local address 127.0.0.1:45550)
0811 02:37:04.663804 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.663853 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:04.664393 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:04.664731 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:04.664734 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:04.665149 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:04.665402 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.665409 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.666576 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.666578 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.667249 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.667251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.667979 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.667981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.668071 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.668647 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:04.668656 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:04.670132 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:04.672256 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.672263 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.672272 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.672476 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.672759 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.672760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.672760 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.672840 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.673344 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:04.673352 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:04.673414 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 02:37:04.673505 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 02:37:04.673655 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260811 02:37:04.673895 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.663688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45550 (local address 127.17.79.62:43571)
0811 02:37:04.663885 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:04.663889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:04.663920 (+ 31us) server_negotiation.cc:407] Connection header received
0811 02:37:04.664561 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:04.664563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:04.664583 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:04.664665 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:04.665518 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.666448 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.667337 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.667836 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.667970 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.670221 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:04.670252 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:04.670252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:04.670260 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:04.672162 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.672568 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.672572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.672572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.672685 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.672926 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.672927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.672927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.673238 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:04.673343 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:04.673564 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 02:37:04.673752 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
I20260811 02:37:04.674647 25478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:04.675012 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.674889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51452)
0811 02:37:04.674940 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.674985 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 02:37:04.675155 25391 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
I20260811 02:37:04.675520 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.675422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51464)
0811 02:37:04.675475 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.675500 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 02:37:04.675648 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:44701: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab.
Entry for principal kudu/127.17.79.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab.
I20260811 02:37:04.690471 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:44701
--webserver_interface=127.17.79.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab
--principal=kudu/127.17.79.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43571,127.17.79.61:44701,127.17.79.60:35565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:37:04.724844 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } attempt: 1
I20260811 02:37:04.725325 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.725182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51466)
0811 02:37:04.725248 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.725297 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 02:37:04.725804 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.725697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51478)
0811 02:37:04.725745 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.725776 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 02:37:04.725912 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:44701: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
W20260811 02:37:04.777098 25485 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 02:37:04.777315 25485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:37:04.777334 25485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:37:04.777357 25485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:37:04.778524 25485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:37:04.778571 25485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:37:04.778589 25485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:37:04.778604 25485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:37:04.778620 25485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:37:04.780148 25485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43571,127.17.79.61:44701,127.17.79.60:35565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.61.keytab
--principal=kudu/127.17.79.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.61:44701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.79.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:37:04.780408 25485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:37:04.780663 25485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 02:37:04.785861 25492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:04.785869 25499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:04.785869 25491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:37:04.785888 25485 server_base.cc:1034] running on GCE node
I20260811 02:37:04.786392 25485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:37:04.786688 25485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:37:04.787859 25485 hybrid_clock.cc:648] HybridClock initialized: now 1786415824787853 us; error 35 us; skew 500 ppm
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:37:04.790417 25485 init.cc:377] Logged in from keytab as kudu/127.17.79.61@KRBTEST.COM (short username kudu)
I20260811 02:37:04.790838 25485 webserver.cc:460] Webserver started at http://127.17.79.61:46037/ using document root <none> and password file <none>
I20260811 02:37:04.791086 25485 fs_manager.cc:359] Metadata directory not provided
I20260811 02:37:04.791167 25485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:37:04.791313 25485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:37:04.792347 25485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data/instance:
uuid: "3120fca1bf724ec9a61bdb0db4a58bc4"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "f22cb937d15ca6022d94dd9606075382"
server_key_iv: "4ada1f7a3c4fd08e238db442658ab582"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.792713 25485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/wal/instance:
uuid: "3120fca1bf724ec9a61bdb0db4a58bc4"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "f22cb937d15ca6022d94dd9606075382"
server_key_iv: "4ada1f7a3c4fd08e238db442658ab582"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.794063 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } attempt: 2
I20260811 02:37:04.794101 25485 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 02:37:04.794476 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.794350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51488)
0811 02:37:04.794411 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.794447 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 02:37:04.794874 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.794782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51504)
0811 02:37:04.794818 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.794843 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 02:37:04.794977 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.61:44701: Network error: Client connection negotiation failed: client connection to 127.17.79.61:44701: connect: Connection refused (error 111)
I20260811 02:37:04.795043 25512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:37:04.795238 25485 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:37:04.795328 25485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/wal
uuid: "3120fca1bf724ec9a61bdb0db4a58bc4"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "f22cb937d15ca6022d94dd9606075382"
server_key_iv: "4ada1f7a3c4fd08e238db442658ab582"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.795416 25485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:37:04.819852 25485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:37:04.822032 25485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:37:04.822217 25485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:37:04.827039 25485 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.61:44701
I20260811 02:37:04.827080 25607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.61:44701 every 8 connection(s)
I20260811 02:37:04.827564 25485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/data/info.pb
I20260811 02:37:04.828881 25611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:37:04.830792 25611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:04.836283 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 25485
I20260811 02:37:04.836385 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-1/wal/instance
I20260811 02:37:04.836588 17724 external_mini_cluster.cc:1428] Setting key d806931dfb768c2807bef7bc2c2d79a8
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:37:04.840478 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.831571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45564 (local address 127.17.79.62:43571)
0811 02:37:04.831644 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:04.831646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:04.831797 (+ 151us) server_negotiation.cc:407] Connection header received
0811 02:37:04.832274 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:04.832275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:04.832287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:04.832357 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:04.832946 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.833442 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.834567 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.834774 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.834834 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.837162 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:04.837164 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:04.837165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:04.837173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:04.838814 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.839364 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.839364 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.839365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.839417 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.839736 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.839737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.839737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.839891 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:04.839957 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:04.840239 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 02:37:04.840336 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 02:37:04.840487 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.831484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43571 (local address 127.0.0.1:45564)
0811 02:37:04.831665 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.831707 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:04.832186 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:04.832425 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:04.832428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:04.832676 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:04.832869 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.832873 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.833549 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.833550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.834477 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.834480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.834869 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.834870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.834979 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.835497 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:04.835506 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:04.837067 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:04.838899 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.838908 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.838910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.839275 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.839489 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.839489 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.839490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.839657 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.839962 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:04.839974 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:04.840099 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 02:37:04.840195 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 02:37:04.840324 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":102,"threads_started":1}
I20260811 02:37:04.841220 25611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.79.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.79.60@KRBTEST.COM" created.
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:37:04.851480 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.841499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51516)
0811 02:37:04.841556 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.841567 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:04.841621 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:04.841983 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:04.841984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:04.842151 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:04.842209 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.842210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.843100 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.843101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.843591 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.843592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.844065 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.844066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.844135 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.844603 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:04.844608 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:04.848515 (+ 3907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:04.850416 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.850417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.850417 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.850579 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.850799 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.850800 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.850801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.850855 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.851156 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:04.851157 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:04.851198 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 02:37:04.851261 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 02:37:04.851359 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 02:37:04.851763 25617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.841547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51516 (local address 127.17.79.61:44701)
0811 02:37:04.841724 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:04.841729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:04.841752 (+ 23us) server_negotiation.cc:407] Connection header received
0811 02:37:04.841839 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:04.841847 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:04.841867 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:04.841983 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:04.842320 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.842998 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.843679 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.843977 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.844067 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.848619 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:04.848628 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:04.848628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:04.848635 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:04.850324 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.850669 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.850672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.850672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.850733 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.850928 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.850929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.850929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.851078 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:04.851166 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:04.851289 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 02:37:04.851429 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260811 02:37:04.852399 25611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:04.852852 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.852685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48278)
0811 02:37:04.852718 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.852795 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 02:37:04.853585 25513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
I20260811 02:37:04.856382 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.854993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48294)
0811 02:37:04.856288 (+ 1295us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.856347 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1273}
W20260811 02:37:04.856576 25611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35565: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.79.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab.
Entry for principal kudu/127.17.79.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab.
I20260811 02:37:04.866677 17724 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskyYEYPK/build/release/bin/kudu
/tmp/dist-test-taskyYEYPK/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:35565
--webserver_interface=127.17.79.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab
--principal=kudu/127.17.79.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.79.20:45291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.79.62:43571,127.17.79.61:44701,127.17.79.60:35565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 02:37:04.886142 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } attempt: 3
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:37:04.895193 25617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.886657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51524 (local address 127.17.79.61:44701)
0811 02:37:04.886727 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:04.886730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:04.886738 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:37:04.886767 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:04.886768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:04.886782 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:04.886838 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:04.887261 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.888042 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.889072 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.889316 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.889412 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.891760 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:04.891762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:04.891762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:04.891770 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:04.893759 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.894216 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.894219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.894220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.894329 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:04.894583 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:04.894584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:04.894584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:04.894774 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:04.894840 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:04.895010 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 02:37:04.895091 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 02:37:04.895202 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.886552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51524)
0811 02:37:04.886616 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.886634 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:04.886671 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:04.886873 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:04.886875 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:04.887074 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:04.887149 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.887151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.888145 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.888146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.888993 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:04.888996 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:04.889412 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:04.889413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:04.889489 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:04.889981 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:04.889987 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:04.891662 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:04.893854 (+ 2192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.893855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.893855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.894107 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.894408 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:04.894408 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:04.894409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:04.894494 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:04.894844 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:04.894845 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:04.894891 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 02:37:04.894985 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 02:37:04.895090 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 02:37:04.896059 25478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
I20260811 02:37:04.896464 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.896342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48306)
0811 02:37:04.896386 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.896413 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 02:37:04.896826 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.896737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48322)
0811 02:37:04.896765 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.896804 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260811 02:37:04.896919 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35565: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
I20260811 02:37:04.905853 25611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } attempt: 1
I20260811 02:37:04.906443 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.906329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48336)
0811 02:37:04.906373 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.906404 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 02:37:04.906800 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.906704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48340)
0811 02:37:04.906752 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.906778 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 02:37:04.906982 25611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35565: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
I20260811 02:37:04.928062 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } attempt: 1
I20260811 02:37:04.928594 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.928448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48342)
0811 02:37:04.928520 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.928562 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 02:37:04.929023 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.928937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48358)
0811 02:37:04.928979 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.929006 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 02:37:04.929185 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35565: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
W20260811 02:37:04.967191 25620 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 02:37:04.967417 25620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 02:37:04.967433 25620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 02:37:04.967454 25620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 02:37:04.968638 25620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 02:37:04.968685 25620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 02:37:04.968700 25620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 02:37:04.968713 25620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 02:37:04.968726 25620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 02:37:04.970297 25620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.79.20:45291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.79.62:43571,127.17.79.61:44701,127.17.79.60:35565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/krb5kdc/kudu_127.17.79.60.keytab
--principal=kudu/127.17.79.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.79.60:35565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.79.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 01:46:40 UTC on ccycloud.quasar-juvatc.root.comops.site
build id 4579571
I20260811 02:37:04.970548 25620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 02:37:04.970824 25620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 02:37:04.975273 25611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } attempt: 2
I20260811 02:37:04.975824 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.975597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48366)
0811 02:37:04.975681 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.975721 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 02:37:04.975943 25620 server_base.cc:1034] running on GCE node
W20260811 02:37:04.975951 25632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:04.976076 25630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 02:37:04.976189 25635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 02:37:04.976210 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:04.976122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48380)
0811 02:37:04.976157 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:04.976189 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 02:37:04.976289 25611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35565: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
I20260811 02:37:04.976434 25620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 02:37:04.976745 25620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 02:37:04.977900 25620 hybrid_clock.cc:648] HybridClock initialized: now 1786415824977884 us; error 29 us; skew 500 ppm
Aug 11 02:37:04 dist-test-slave-7nm7 krb5kdc[25346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 02:37:04.984249 25620 init.cc:377] Logged in from keytab as kudu/127.17.79.60@KRBTEST.COM (short username kudu)
I20260811 02:37:04.984836 25620 webserver.cc:460] Webserver started at http://127.17.79.60:39749/ using document root <none> and password file <none>
I20260811 02:37:04.985128 25620 fs_manager.cc:359] Metadata directory not provided
I20260811 02:37:04.985205 25620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 02:37:04.985369 25620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 02:37:04.986577 25620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data/instance:
uuid: "d295444c521c4e3097e1ba0490f6dd4e"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "948d227b6d1feaac65438226aa528ac7"
server_key_iv: "c0492215fdd2c883804320a703e06701"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.986955 25620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/wal/instance:
uuid: "d295444c521c4e3097e1ba0490f6dd4e"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "948d227b6d1feaac65438226aa528ac7"
server_key_iv: "c0492215fdd2c883804320a703e06701"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.988507 25620 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 02:37:04.989655 25647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 02:37:04.989923 25620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 02:37:04.990041 25620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data,/tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/wal
uuid: "d295444c521c4e3097e1ba0490f6dd4e"
format_stamp: "Formatted at 2026-08-11 02:37:04 on dist-test-slave-7nm7"
server_key: "948d227b6d1feaac65438226aa528ac7"
server_key_iv: "c0492215fdd2c883804320a703e06701"
server_key_version: "encryptionkey@0"
I20260811 02:37:04.990139 25620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 02:37:05.004356 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } attempt: 2
I20260811 02:37:05.004853 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.004706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48386)
0811 02:37:05.004781 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:05.004821 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 02:37:05.005236 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.005136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48390)
0811 02:37:05.005186 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:05.005217 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 02:37:05.005419 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.79.60:35565: Network error: Client connection negotiation failed: client connection to 127.17.79.60:35565: connect: Connection refused (error 111)
I20260811 02:37:05.006093 25620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 02:37:05.008296 25620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 02:37:05.008561 25620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 02:37:05.012907 25620 rpc_server.cc:307] RPC server started. Bound to: 127.17.79.60:35565
I20260811 02:37:05.012957 25742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.79.60:35565 every 8 connection(s)
I20260811 02:37:05.013397 25620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/data/info.pb
I20260811 02:37:05.014565 25743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 02:37:05.016099 25743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
I20260811 02:37:05.023512 17724 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskyYEYPK/build/release/bin/kudu as pid 25620
I20260811 02:37:05.023653 17724 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskyYEYPK/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786415535404356-17724-0/minicluster-data/master-2/wal/instance
I20260811 02:37:05.023895 17724 external_mini_cluster.cc:1428] Setting key bea708514735c0864f69a80c8078a0ed
I20260811 02:37:05.027591 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.016863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45580 (local address 127.17.79.62:43571)
0811 02:37:05.016933 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.016936 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.017230 (+ 294us) server_negotiation.cc:407] Connection header received
0811 02:37:05.017755 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.017757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.017770 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.017819 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.018887 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.019379 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.020363 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.020573 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.020663 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.023146 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.023149 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.023149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.023168 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.025871 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.026511 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.026512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.026512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.026568 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.026871 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.026871 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.026872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.026995 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.027048 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.027402 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.027494 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:37:05.027602 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.016852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.62:43571 (local address 127.0.0.1:45580)
0811 02:37:05.017087 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:05.017137 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:05.017640 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:05.017893 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:05.017897 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:05.018541 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:05.018777 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.018782 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.019479 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.019480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.020265 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.020267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.020685 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.020686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.020809 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.021429 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:05.021438 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:05.022954 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:05.025945 (+ 2991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.025950 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.025952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.026400 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.026649 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.026650 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.026650 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.026791 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.027060 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:05.027065 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:05.027235 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 02:37:05.027315 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 02:37:05.027436 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":118,"threads_started":1}
I20260811 02:37:05.028349 25743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:37:05.034557 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.024523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48392 (local address 127.17.79.60:35565)
0811 02:37:05.024667 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.024672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.024815 (+ 143us) server_negotiation.cc:407] Connection header received
0811 02:37:05.024851 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.024853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.024869 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.024964 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.025933 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.027109 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.028095 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.028507 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.028572 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.031403 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.031440 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.031441 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.031449 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.033174 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.033594 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.033597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.033597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.033651 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.033855 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.033855 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.033856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.034058 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.034228 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.034370 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.034434 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
I20260811 02:37:05.036518 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.028649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.61:44701 (local address 127.0.0.1:51528)
0811 02:37:05.028703 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:05.028713 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:05.028746 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:05.028949 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:05.028950 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:05.029140 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:05.029196 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.029213 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.029985 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.029987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.030578 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.030580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.031061 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.031062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.031123 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.031511 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:05.031515 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:05.032948 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:05.035478 (+ 2530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.035479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.035479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.035710 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.035917 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.035918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.035919 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.035991 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.036296 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:05.036297 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:05.036333 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 02:37:05.036387 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 02:37:05.036456 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 02:37:05.036619 25617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.028748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51528 (local address 127.17.79.61:44701)
0811 02:37:05.028819 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.028821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.028830 (+ 9us) server_negotiation.cc:407] Connection header received
0811 02:37:05.028859 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.028860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.028872 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.028927 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.029314 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.029901 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.030643 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.030985 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.031066 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.033054 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.033055 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.033055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.033062 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.035384 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.035790 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.035791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.035791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.035846 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.036058 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.036059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.036059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.036220 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.036292 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.036428 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.036512 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 02:37:05.036937 25743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.62@KRBTEST.COM
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.60@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:37:05.043632 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.035457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45586 (local address 127.17.79.62:43571)
0811 02:37:05.035497 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.035498 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.035506 (+ 8us) server_negotiation.cc:407] Connection header received
0811 02:37:05.035530 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.035530 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.035539 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.035600 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.036227 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.036933 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.037879 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.038072 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.038158 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.040766 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.040768 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.040768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.040775 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.042394 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.042810 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.042811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.042811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.042862 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.043066 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.043067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.043067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.043164 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.043279 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.043434 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.043515 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:37:05.044508 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.037220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48406)
0811 02:37:05.037262 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:05.037310 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:05.037343 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:05.037459 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:05.037459 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:05.037601 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:05.037634 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.037636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.038326 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.038328 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.039101 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.039105 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.039496 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.039497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.039562 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.040049 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:05.040053 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:05.041245 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:05.043364 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.043365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.043365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.043589 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.043795 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.043796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.043796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.043865 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.044165 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:05.044166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:05.044218 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 02:37:05.044297 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 02:37:05.044392 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 02:37:05.044610 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.037286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.17.79.60:35565)
0811 02:37:05.037357 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.037358 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.037365 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:37:05.037398 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.037399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.037409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.037447 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.037723 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.038195 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.039215 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.039412 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.039470 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.041329 (+ 1859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.041330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.041330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.041337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.043270 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.043659 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.043660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.043660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.043729 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.043944 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.043946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.043946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.044085 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.044154 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.044337 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.044457 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":52}
I20260811 02:37:05.046327 25743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: Bootstrap starting.
I20260811 02:37:05.047425 25743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: Neither blocks nor log segments found. Creating new log.
I20260811 02:37:05.047724 25743 log.cc:824] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: Log is configured to *not* fsync() on all Append() calls
I20260811 02:37:05.048623 25743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: No bootstrap required, opened a new log
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.79.61@KRBTEST.COM
I20260811 02:37:05.050913 25743 raft_consensus.cc:348] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
I20260811 02:37:05.051043 25743 raft_consensus.cc:729] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d295444c521c4e3097e1ba0490f6dd4e, State: Initialized, Role: FOLLOWER
I20260811 02:37:05.051278 25743 consensus_queue.cc:260] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
I20260811 02:37:05.051651 25755 sys_catalog.cc:455] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.051712 25743 sys_catalog.cc:564] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:37:05.051788 25755 sys_catalog.cc:458] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:05.052484 25617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.044460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51534 (local address 127.17.79.61:44701)
0811 02:37:05.044500 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.044502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.044509 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:37:05.044533 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.044534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.044545 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.044604 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.045230 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.045890 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.046666 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.047020 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.047104 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.049703 (+ 2599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.049705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.049705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.049712 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.051226 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.051634 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.051635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.051636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.051700 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.051907 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.051908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.051908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.052025 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.052145 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.052296 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.052381 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 02:37:05.053802 25775 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:37:05.053860 25775 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:37:05.054500 17724 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 02:37:05.055328 25443 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6404109cc53c4adbb45a679237b72316"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45586
I20260811 02:37:05.054307 25620 master_runner.cc:186] Error getting master registration for 127.17.79.62:43571: OK, instance_id { permanent_uuid: "6404109cc53c4adbb45a679237b72316" instance_seqno: 1786415824658780 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 02:37:05.056689 25620 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 02:37:05.067441 25611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } attempt: 3
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.61@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:37:05.075102 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.067791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48410)
0811 02:37:05.067856 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:05.067869 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:05.067918 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:05.068074 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:05.068075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:05.068252 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:05.068299 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.068300 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.068943 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.068944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.069425 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.069426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.069769 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.069770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.069823 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.070379 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:05.070384 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:05.071987 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:05.073885 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.073886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.073887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.074121 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.074370 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.074370 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.074371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.074440 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.074766 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:05.074767 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:05.074817 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 02:37:05.074894 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 02:37:05.074995 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 02:37:05.075110 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.067866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48410 (local address 127.17.79.60:35565)
0811 02:37:05.067916 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.067918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.067929 (+ 11us) server_negotiation.cc:407] Connection header received
0811 02:37:05.067979 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.067980 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.067990 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.068056 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.068388 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.068852 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.069505 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.069696 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.069772 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.072098 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.072099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.072100 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.072108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.073795 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.074203 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.074204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.074205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.074297 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.074506 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.074507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.074507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.074694 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.074760 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.074929 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.075006 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:37:05.076546 25611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: Bootstrap starting.
I20260811 02:37:05.077220 25611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: Neither blocks nor log segments found. Creating new log.
I20260811 02:37:05.077515 25611 log.cc:824] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: Log is configured to *not* fsync() on all Append() calls
I20260811 02:37:05.078361 25611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: No bootstrap required, opened a new log
I20260811 02:37:05.079744 25611 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
I20260811 02:37:05.079877 25611 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3120fca1bf724ec9a61bdb0db4a58bc4, State: Initialized, Role: FOLLOWER
I20260811 02:37:05.079962 25611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
I20260811 02:37:05.080273 25784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.080348 25611 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:37:05.080366 25784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 02:37:05.082136 25801 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:37:05.082211 25801 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:37:05.082466 25485 master_runner.cc:186] Error getting master registration for 127.17.79.62:43571: OK, instance_id { permanent_uuid: "6404109cc53c4adbb45a679237b72316" instance_seqno: 1786415824658780 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 02:37:05.085393 25485 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 02:37:05.104544 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } attempt: 3
Aug 11 02:37:05 dist-test-slave-7nm7 krb5kdc[25346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786415824, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.79.62@KRBTEST.COM for kudu/127.17.79.60@KRBTEST.COM
I20260811 02:37:05.112401 25480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.104941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.79.60:35565 (local address 127.0.0.1:48422)
0811 02:37:05.105001 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 02:37:05.105015 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 02:37:05.105076 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 02:37:05.105219 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 02:37:05.105220 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 02:37:05.105394 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 02:37:05.105441 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.105443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.106386 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.106387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.106877 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 02:37:05.106878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.107324 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.107325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 02:37:05.107381 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.107869 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 02:37:05.107873 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 02:37:05.109535 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 02:37:05.111270 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.111271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.111271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.111497 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.111700 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 02:37:05.111702 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 02:37:05.111702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 02:37:05.111771 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 02:37:05.112058 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 02:37:05.112059 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 02:37:05.112103 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 02:37:05.112188 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 02:37:05.112298 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 02:37:05.112401 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.105026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48422 (local address 127.17.79.60:35565)
0811 02:37:05.105070 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.105072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.105084 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:37:05.105143 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.105144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.105156 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.105206 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.105529 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.106296 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.106970 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.107263 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.107325 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.109642 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.109644 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.109644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.109653 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.111157 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.111567 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.111568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.111568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.111621 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.111825 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.111825 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.111826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.111974 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.112051 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.112227 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.112298 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 02:37:05.114601 25478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316: Bootstrap starting.
I20260811 02:37:05.115393 25478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316: Neither blocks nor log segments found. Creating new log.
I20260811 02:37:05.115721 25478 log.cc:824] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316: Log is configured to *not* fsync() on all Append() calls
I20260811 02:37:05.116519 25478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316: No bootstrap required, opened a new log
I20260811 02:37:05.117686 25478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
I20260811 02:37:05.117830 25478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6404109cc53c4adbb45a679237b72316, State: Initialized, Role: FOLLOWER
I20260811 02:37:05.117920 25478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
I20260811 02:37:05.118213 25807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.118350 25443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 02:37:05.118366 25807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:05.118412 25443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:37:05.119095 25443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
I20260811 02:37:05.119377 25443 leader_election.cc:288] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [CANDIDATE]: Term 1 election: Requested vote from peers 3120fca1bf724ec9a61bdb0db4a58bc4 (127.17.79.61:44701), d295444c521c4e3097e1ba0490f6dd4e (127.17.79.60:35565)
I20260811 02:37:05.119776 25696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6404109cc53c4adbb45a679237b72316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d295444c521c4e3097e1ba0490f6dd4e"
I20260811 02:37:05.119910 25696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:37:05.120093 25556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6404109cc53c4adbb45a679237b72316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4"
I20260811 02:37:05.120244 25556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 02:37:05.121136 25696 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6404109cc53c4adbb45a679237b72316 in term 1.
I20260811 02:37:05.121136 25556 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6404109cc53c4adbb45a679237b72316 in term 1.
I20260811 02:37:05.121383 25389 leader_election.cc:302] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6404109cc53c4adbb45a679237b72316, d295444c521c4e3097e1ba0490f6dd4e; no voters:
I20260811 02:37:05.118454 25478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 02:37:05.122515 25807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 02:37:05.122727 25807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [term 1 LEADER]: Becoming Leader. State: Replica: 6404109cc53c4adbb45a679237b72316, State: Running, Role: LEADER
I20260811 02:37:05.122871 25807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } }
W20260811 02:37:05.124966 25835 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 02:37:05.125023 25835 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 02:37:05.123503 25807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6404109cc53c4adbb45a679237b72316. Latest consensus state: current_term: 1 leader_uuid: "6404109cc53c4adbb45a679237b72316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.125193 25807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: This master's current role is: LEADER
I20260811 02:37:05.126443 25848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 02:37:05.126685 25848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 02:37:05.128520 25696 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [term 1 FOLLOWER]: Refusing update from remote peer 6404109cc53c4adbb45a679237b72316: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:37:05.128539 25556 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [term 1 FOLLOWER]: Refusing update from remote peer 6404109cc53c4adbb45a679237b72316: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 02:37:05.128844 25828 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:37:05.129026 25807 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 02:37:05.130211 25755 sys_catalog.cc:455] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6404109cc53c4adbb45a679237b72316. Latest consensus state: current_term: 1 leader_uuid: "6404109cc53c4adbb45a679237b72316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.130326 25755 sys_catalog.cc:458] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:05.131479 25784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6404109cc53c4adbb45a679237b72316. Latest consensus state: current_term: 1 leader_uuid: "6404109cc53c4adbb45a679237b72316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.131597 25784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:05.137481 25617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.124143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51538 (local address 127.17.79.61:44701)
0811 02:37:05.124185 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.124187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.126286 (+ 2099us) server_negotiation.cc:407] Connection header received
0811 02:37:05.126495 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.126496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.126508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.126558 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.129794 (+ 3236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.130484 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.132260 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.132549 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.132612 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.134329 (+ 1717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.134331 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.134332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.134339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.136106 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.136511 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.136512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.136513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.136571 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.136806 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.136807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.136807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.136949 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.137027 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.137275 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.137367 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 02:37:05.139591 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.123776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45590 (local address 127.17.79.62:43571)
0811 02:37:05.123820 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.123823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.125181 (+ 1358us) server_negotiation.cc:407] Connection header received
0811 02:37:05.125285 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.125286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.125296 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.125328 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.128109 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.128809 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.133938 (+ 5129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.134286 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.134326 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.136251 (+ 1925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.136252 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.136252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.136259 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.137974 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.138697 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.138699 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.138699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.138758 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.138980 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.138981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.138981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.139135 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.139222 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.139421 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.139499 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 02:37:05.142251 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:05.124581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48424 (local address 127.17.79.60:35565)
0811 02:37:05.124624 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.124626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.126443 (+ 1817us) server_negotiation.cc:407] Connection header received
0811 02:37:05.127339 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.127341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.127352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.127381 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.130747 (+ 3366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.131398 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.133108 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:05.133407 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:05.133452 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:05.139489 (+ 6037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 02:37:05.139490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 02:37:05.139490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 02:37:05.139497 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 02:37:05.141014 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.141420 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.141421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.141421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.141478 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 02:37:05.141678 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 02:37:05.141679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 02:37:05.141680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 02:37:05.141801 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 02:37:05.141875 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:05.142069 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 02:37:05.142143 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:37:05.149539 25807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6404109cc53c4adbb45a679237b72316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.149644 25807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: This master's current role is: LEADER
I20260811 02:37:05.150007 25849 mvcc.cc:205] Tried to move back new op lower bound from 7317159219723296768 to 7317159219704180736. Current Snapshot: MvccSnapshot[applied={T|T < 7317159219723296768}]
I20260811 02:37:05.150103 25755 sys_catalog.cc:455] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6404109cc53c4adbb45a679237b72316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.150195 25755 sys_catalog.cc:458] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:05.150338 25828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6404109cc53c4adbb45a679237b72316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.150424 25828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316 [sys.catalog]: This master's current role is: LEADER
I20260811 02:37:05.150868 25784 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6404109cc53c4adbb45a679237b72316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6404109cc53c4adbb45a679237b72316" member_type: VOTER last_known_addr { host: "127.17.79.62" port: 43571 } } peers { permanent_uuid: "3120fca1bf724ec9a61bdb0db4a58bc4" member_type: VOTER last_known_addr { host: "127.17.79.61" port: 44701 } } peers { permanent_uuid: "d295444c521c4e3097e1ba0490f6dd4e" member_type: VOTER last_known_addr { host: "127.17.79.60" port: 35565 } } }
I20260811 02:37:05.150964 25784 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 02:37:05.151283 25850 mvcc.cc:205] Tried to move back new op lower bound from 7317159219723296768 to 7317159219704180736. Current Snapshot: MvccSnapshot[applied={T|T < 7317159219723296768}]
I20260811 02:37:05.151401 25854 mvcc.cc:205] Tried to move back new op lower bound from 7317159219723296768 to 7317159219704180736. Current Snapshot: MvccSnapshot[applied={T|T < 7317159219723296768}]
I20260811 02:37:05.154628 25848 catalog_manager.cc:1347] Generated new cluster ID: beca8848724048fe87cc99ef7cf133bb
I20260811 02:37:05.154695 25848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 02:37:05.163456 25848 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 02:37:05.164208 25848 catalog_manager.cc:1504] Loading token signing keys...
I20260811 02:37:05.176465 25848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6404109cc53c4adbb45a679237b72316: Generated new TSK 0
I20260811 02:37:05.176724 25848 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 02:37:05.200773 25481 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.198582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45602 (local address 127.17.79.62:43571)
0811 02:37:05.198632 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.198634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.199951 (+ 1317us) server_negotiation.cc:407] Connection header received
0811 02:37:05.200083 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.200085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.200099 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.200136 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.200694 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45602: BlockingRecv error: recv got EOF from 127.0.0.1:45602 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 02:37:05.201783 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.198972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51552 (local address 127.17.79.61:44701)
0811 02:37:05.199018 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.199020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.201062 (+ 2042us) server_negotiation.cc:407] Connection header received
0811 02:37:05.201298 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.201299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.201313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.201348 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.201717 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51552: BlockingRecv error: recv got EOF from 127.0.0.1:51552 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 02:37:05.202677 25748 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.199582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48430 (local address 127.17.79.60:35565)
0811 02:37:05.199631 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.199633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.201237 (+ 1604us) server_negotiation.cc:407] Connection header received
0811 02:37:05.202026 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.202027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.202040 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.202075 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.202612 (+ 537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48430: BlockingRecv error: recv got EOF from 127.0.0.1:48430 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 02:37:05.205360 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.204446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51564 (local address 127.17.79.61:44701)
0811 02:37:05.204486 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.204488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.204768 (+ 280us) server_negotiation.cc:407] Connection header received
0811 02:37:05.204898 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.204899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.204918 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.204953 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.205312 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51564: BlockingRecv error: recv got EOF from 127.0.0.1:51564 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 02:37:05.208715 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.207905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51576 (local address 127.17.79.61:44701)
0811 02:37:05.207938 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.207940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.208214 (+ 274us) server_negotiation.cc:407] Connection header received
0811 02:37:05.208310 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.208311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.208321 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.208349 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.208668 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51576: BlockingRecv error: recv got EOF from 127.0.0.1:51576 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 02:37:05.212699 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.211768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51580 (local address 127.17.79.61:44701)
0811 02:37:05.211804 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.211806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.212050 (+ 244us) server_negotiation.cc:407] Connection header received
0811 02:37:05.212167 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.212168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.212178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.212208 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.212655 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51580: BlockingRecv error: recv got EOF from 127.0.0.1:51580 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 02:37:05.218789 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.217916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51592 (local address 127.17.79.61:44701)
0811 02:37:05.217952 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.217954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.218219 (+ 265us) server_negotiation.cc:407] Connection header received
0811 02:37:05.218349 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.218350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.218361 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.218393 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.218739 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51592: BlockingRecv error: recv got EOF from 127.0.0.1:51592 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 02:37:05.228935 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.228025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51604 (local address 127.17.79.61:44701)
0811 02:37:05.228074 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.228075 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.228367 (+ 292us) server_negotiation.cc:407] Connection header received
0811 02:37:05.228468 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.228469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.228480 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.228509 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.228880 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51604: BlockingRecv error: recv got EOF from 127.0.0.1:51604 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 02:37:05.247335 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.246337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51616 (local address 127.17.79.61:44701)
0811 02:37:05.246385 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.246388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.246693 (+ 305us) server_negotiation.cc:407] Connection header received
0811 02:37:05.246799 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.246800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.246811 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.246842 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.247272 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51616: BlockingRecv error: recv got EOF from 127.0.0.1:51616 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 02:37:05.281854 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.280831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51622 (local address 127.17.79.61:44701)
0811 02:37:05.280912 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.280914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.281037 (+ 123us) server_negotiation.cc:407] Connection header received
0811 02:37:05.281257 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.281258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.281270 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.281357 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.281789 (+ 432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51622: BlockingRecv error: recv got EOF from 127.0.0.1:51622 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 02:37:05.348560 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.347723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.17.79.61:44701)
0811 02:37:05.347808 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.347811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.347910 (+ 99us) server_negotiation.cc:407] Connection header received
0811 02:37:05.347999 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.348000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.348019 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.348085 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.348487 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51634: BlockingRecv error: recv got EOF from 127.0.0.1:51634 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 02:37:05.478543 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.477818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51642 (local address 127.17.79.61:44701)
0811 02:37:05.477882 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.477888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.477903 (+ 15us) server_negotiation.cc:407] Connection header received
0811 02:37:05.477971 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.477972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.477983 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.478048 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.478479 (+ 431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51642: BlockingRecv error: recv got EOF from 127.0.0.1:51642 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 02:37:05.736486 25617 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 02:37:05.735822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51658 (local address 127.17.79.61:44701)
0811 02:37:05.735900 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:05.735902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:05.735956 (+ 54us) server_negotiation.cc:407] Connection header received
0811 02:37:05.736019 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:05.736020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:05.736030 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:05.736076 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 02:37:05.736427 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51658: BlockingRecv error: recv got EOF from 127.0.0.1:51658 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 02:37:06.054383 25775 catalog_manager.cc:1259] Loaded cluster ID: beca8848724048fe87cc99ef7cf133bb
I20260811 02:37:06.054497 25775 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: loading cluster ID for follower catalog manager: success
I20260811 02:37:06.055332 25775 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: acquiring CA information for follower catalog manager: success
I20260811 02:37:06.055644 25775 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d295444c521c4e3097e1ba0490f6dd4e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 02:37:06.082741 25801 catalog_manager.cc:1259] Loaded cluster ID: beca8848724048fe87cc99ef7cf133bb
I20260811 02:37:06.082823 25801 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: loading cluster ID for follower catalog manager: success
I20260811 02:37:06.083683 25801 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: acquiring CA information for follower catalog manager: success
I20260811 02:37:06.083994 25801 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3120fca1bf724ec9a61bdb0db4a58bc4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 02:37:06.252574 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:06.249738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51662 (local address 127.17.79.61:44701)
0811 02:37:06.249881 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:06.249884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:06.249896 (+ 12us) server_negotiation.cc:407] Connection header received
0811 02:37:06.249927 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:06.249928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:06.250008 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:06.250104 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:06.250310 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.250815 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.251615 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.251838 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.251931 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:06.252130 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:06.252292 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:06.252379 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:06.252448 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 02:37:06.252471 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":62,"threads_started":1}
I20260811 02:37:06.257341 25989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:06.254875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48434 (local address 127.17.79.60:35565)
0811 02:37:06.254990 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:06.254992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:06.254999 (+ 7us) server_negotiation.cc:407] Connection header received
0811 02:37:06.255053 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:06.255054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:06.255089 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:06.255175 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:06.255309 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.255796 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.256511 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.256729 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.256802 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:06.256965 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:06.257087 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:06.257170 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:06.257223 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 02:37:06.257247 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":47,"threads_started":1}
I20260811 02:37:06.261996 25977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:06.259292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51670 (local address 127.17.79.61:44701)
0811 02:37:06.259333 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:06.259335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:06.259438 (+ 103us) server_negotiation.cc:407] Connection header received
0811 02:37:06.259551 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:06.259552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:06.259563 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:06.259619 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:06.259721 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.260189 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.261254 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.261567 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.261636 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:06.261746 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:06.261778 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:06.261824 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:06.261886 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 02:37:06.261908 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 02:37:06.262189 26000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:06.259081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45618 (local address 127.17.79.62:43571)
0811 02:37:06.259190 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:06.259192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:06.259292 (+ 100us) server_negotiation.cc:407] Connection header received
0811 02:37:06.259433 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:06.259435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:06.259487 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:06.259578 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:06.259758 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.260325 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.261074 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.261349 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.261412 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:06.261621 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:06.261728 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:06.261781 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:06.261980 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 02:37:06.262004 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":51,"threads_started":1}
I20260811 02:37:06.262967 25989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 02:37:06.259169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48438 (local address 127.17.79.60:35565)
0811 02:37:06.259212 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 02:37:06.259214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 02:37:06.259457 (+ 243us) server_negotiation.cc:407] Connection header received
0811 02:37:06.259509 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 02:37:06.259510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 02:37:06.259522 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 02:37:06.259573 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 02:37:06.260303 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.261029 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.262063 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 02:37:06.262489 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 02:37:06.262558 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 02:37:06.262724 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 02:37:06.262755 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 02:37:06.262805 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 02:37:06.262867 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 02:37:06.262889 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 02:37:06.264092 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 25366
I20260811 02:37:06.289003 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 25485
I20260811 02:37:06.300849 17724 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskyYEYPK/build/release/bin/kudu with pid 25620
2026-08-11T02:37:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3222 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6349 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (290908 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST